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About This Guide 



This guide provides cabling information for the HP High Performance Clusters LC 1000 
Series. 

Audience Assumptions 

This guide is for the person who installs, administers, and troubleshoots servers. HP assumes 
you are qualified in the servicing of computer equipment and trained in recognizing hazards 
in products with hazardous energy levels and are familiar with weight and stability 
precautions for rack installations. 

Where to Go for Additional Help 

In addition to this guide, the following information sources are available: 

• User documentation for the cluster components 

• HP High Performance Clusters LC Series Setup and Installation Guide 

Technical Support 

Refer to the HP High Performance Clusters LC Series Setup and Installation Guide for 
technical support. 
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Server and Switch Connections 



Server Connections 
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Figure 1-1 : DL140 rear view 
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Figure 1-2: DL140 rear view with Myrinet adapter 
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Figure 1-3: DL380 rear view 
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Server and Switch Connections 



Switch Connections 
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Figure 1-4: Cyclades terminal server rear view 
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Figure 1-5: ProCurve 2650 rear view 
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Figure 1-6: ProCurve 2848 rear view 
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Figure 1-7: ProCurve 5372 rear view showing all modules 
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Server and Switch Connections 
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Figure 1-8: Myricom 5 slot switch rear view 
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Figure 1-9: Myricom 9 slot switch rear view 
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Figure 1-10: Myricom 17 slot switch rear view 
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16 Node Myrinet Expandable to 32 Nodes 
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16 Node Myrinet Expandable to 32 Nodes 



Rack Diagram 



Rack 1 (R1) 
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Point-to-Point Cabling Guide 



Table 2-1 : Cable Label Nomenclature 


Symbol 


Description 


R 


Rack number 


S 


Control/Compute/Storage node number 


SW 


Out of Band (OOB) Management Switch/Cluster Interconnect Switch/In Band (IB) 
Management Switch number 


M 


Module letter or Module number 


P 


Port number 


NIC 


NIC port number 


SER 


Serial port 


PCI 


Myrinet Adapter (in PCI slot) 



Table 2-2: 16 Node Myrinet Cabling for DL140 LC Clusters Expandable to 32 Nodes 


OOB Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R1-S1-SER 


R1-SW3-P1 


R1-S1-PCI 


R1-SW1-M1-P8 


R1-S1-NIC2 


R1-SW2-P1 


R1-S2-SER 


R1-SW3-P2 


R1-S2-PCI 


R1-SW1-M1-P9 


R1-S2-NIC2 


R1-SW2-P2 


R1-S3-SER 


R1-SW3-P3 


R1-S3-PCI 


R1-SW1-M1-P10 


R1-S3-NIC2 


R1-SW2-P3 


R1-S4-SER 


R1-SW3-P4 


R1-S4-PCI 


R1-SW1-M1-P11 


R1-S4-NIC2 


R1-SW2-P4 


R1-S5-SER 


R1-SW3-P5 


R1-S5-PCI 


R1-SW1-M1-P12 


R1-S5-NIC2 


R1-SW2-P5 


R1-S6-SER 


R1-SW3-P6 


R1-S6-PCI 


R1-SW1-M1-P13 


R1-S6-NIC2 


R1-SW2-P6 


R1-S7-SER 


R1-SW3-P7 


R1-S7-PCI 


R1-SW1-M1-P14 


R1-S7-NIC2 


R1-SW2-P7 


R1-S8-SER 


R1-SW3-P8 


R1-S8-PCI 


R1-SW1-M1-P15 


R1-S8-NIC2 


R1-SW2-P8 


R1-S9-SER 


R1-SW3-P9 


R1-S9-PCI 


R1-SW1-M2-P8 


R1-S9-NIC2 


R1-SW2-P9 


R1-S10-SER 


R1-SW3-P10 


R1-S10-PCI 


R1-SW1-M2-P9 


R1-S10-NIC2 


R1-SW2-P10 


R1-S11-SER 


R1-SW3-P11 


R1-S11-PCI 


R1-SW1-M2-P10 


R1-S11-NIC2 


R1-SW2-P11 


R1-S12-SER 


R1-SW3-P12 


R1-S12-PCI 


R1-SW1-M2-P11 


R1-S12-NIC2 


R1-SW2-P12 


R1-S13-SER 


R1-SW3-P13 


R1-S13-PCI 


R1-SW1-M2-P12 


R1-S13-NIC2 


R1-SW2-P13 



continued 
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Table 2-2: 16 Node Myrinet Cabling for DL140 LC Clusters Expandable to 32 Nodes continued 



00B Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 


Origin (server) 


Destination 

Id HV ■ LVil 1 1 


Origin (server) 


Destination 

1 0 ¥■ llWllJ 


R1-S14-SER 


R1-SW3-P14 


R1-S14-PCI 


R1-SW1-M2-P13 


R1-S14-NIC2 


R1-SW2-P14 


R1-S15-SER 


R1-SW3-P15 


R1-S15-PCI 


R1-SW1-M2-P14 


R1-S15-NIC2 


R1-SW2-P15 


R1-S16-SER 


R1-SW3-P16 


R1-S16-PCI 


R1-SW1-M2-P15 


R1-S16-NIC2 


R1-SW2-P16 


R1-S17-SER 


R1-SW3-P17 


R1-S17-PCI 


R1-SW1-M3-P8 


R1-S17-NIC2 


R1-SW2-P17 


R1-S18-SER 


R1-SW3-P18 


R1-S18-PCI 


R1-SW1-M3-P9 


R1-S18-NIC2 


R1-SW2-P18 


R1-S19-SER 


R1-SW3-P19 


R1-S19-PCI 


R1-SW1-M3-P10 


R1-S19-NIC2 


R1-SW2-P19 


R1-S20-SER 


R1-SW3-P20 


R1-S20-PCI 


R1-SW1-M3-P11 


R1-S20-NIC2 


R1-SW2-P20 


R1-S21-SER 


R1-SW3-P21 


R1-S21-PCI 


R1-SW1-M3-P12 


R1-S21-NIC2 


R1-SW2-P21 


R1-S22-SER 


R1-SW3-P22 


R1-S22-PCI 


R1-SW1-M3-P13 


R1-S22-NIC2 


R1-SW2-P22 


R1-S23-SER 


R1-SW3-P23 


N/A 


N/A 


R1-S23-NIC2 


R1-SW2-P23 


R1-S24-SER 


R1-SW3-P24 


R1-S24-PCI 


R1-SW1-M3-P14 


R1-S24-NIC2 


R1-SW2-P24 


R1-S25-SER 


R1-SW3-P25 


R1-S25-PCI 


R1-SW1-M3-P15 


R1-S25-NIC2 


R1-SW2-P25 


R1-S26-SER 


R1-SW3-P26 


R1-S26-PCI 


R1-SW1-M4-P8 


R1-S26-NIC2 


R1-SW2-P26 


R1-S27-SER 


R1-SW3-P27 


R1-S27-PCI 


R1-SW1-M4-P9 


R1-S27-NIC2 


R1-SW2-P27 


R1-S28-SER 


R1-SW3-P28 


R1-S28-PCI 


R1-SW1-M4-P10 


R1-S28-NIC2 


R1-SW2-P28 


R1-S29-SER 


R1-SW3-P29 


R1-S29-PCI 


R1-SW1-M4-P11 


R1-S29-NIC2 


R1-SW2-P29 


R1-S30-SER 


R1-SW3-P30 


R1-S30-PCI 


R1-SW1-M4-P12 


R1-S30-NIC2 


R1-SW2-P30 


R1-S31-SER 


R1-SW3-P31 


R1-S31-PCI 


R1-SW1-M4-P13 


R1-S31-NIC2 


R1-SW2-P31 


R1-S32-SER 


R1-SW3-P32 


R1-S32-PCI 


R1-SW1-M4-P14 


R1-S32-NIC2 


R1-SW2-P32 


R1-S33-SER 


R1-SW3-P33 


R1-S33-PCI 


R1-SW1-M4-P15 


R1-S33-NIC2 


R1-SW2-P33 



Table 2-3: Myricom Monitor 


From 


To 


R1-SW1-M5-P1 


R1-SW2-P47 



Table 2-4: 00B Management Switch Uplink 


From 


To 


R1-SW3-P48 


R1-SW2-P48 
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16 Node GigE Expandable to 22 Nodes 
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16 Node GigE Expandable to 22 Nodes 



Rack Diagram 



Rack 1 (R1) 
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Table 3-1 : Cable Label Nomenclature 


Symbol 


Description 


R 


Rack number 


S 


Control/Compute/Storage node number 


SW 


Out of Band (OOB) Management Switch/Cluster Interconnect Switch/In Band (IB) 
Management Switch number 


M 


Module letter or Module number 


P 


Port number 


NIC 


NIC port number 


SER 


Serial port 



Table 3-2: 16 Node GigE Cabling for DL140 LC Clusters Expandable to 22 Nodes 


OOB Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R1-S1-SER 


R1-SW2-P1 


R1-S1-NIC1 


R1-SW1-P1 


R1-S1-NIC2 


R1-SW1-P23 


R1-S2-SER 


R1-SW2-P2 


R1-S2-NIC1 


R1-SW1-P2 


R1-S2-NIC2 


R1-SW1-P24 


R1-S3-SER 


R1-SW2-P3 


R1-S3-NIC1 


R1-SW1-P3 


R1-S3-NIC2 


R1-SW1-P25 


R1-S4-SER 


R1-SW2-P4 


R1-S4-NIC1 


R1-SW1-P4 


R1-S4-NIC2 


R1-SW1-P26 


R1-S5-SER 


R1-SW2-P5 


R1-S5-NIC1 


R1-SW1-P5 


R1-S5-NIC2 


R1-SW1-P27 


R1-S6-SER 


R1-SW2-P6 


R1-S6-NIC1 


R1-SW1-P6 


R1-S6-NIC2 


R1-SW1-P28 


R1-S7-SER 


R1-SW2-P7 


R1-S7-NIC1 


R1-SW1-P7 


R1-S7-NIC2 


R1-SW1-P29 


R1-S8-SER 


R1-SW2-P8 


R1-S8-NIC1 


R1-SW1-P8 


R1-S8-NIC2 


R1-SW1-P30 


R1-S9-SER 


R1-SW2-P9 


R1-S9-NIC1 


R1-SW1-P9 


R1-S9-NIC2 


R1-SW1-P31 


R1-S10-SER 


R1-SW2-P10 


R1-S10-NIC1 


R1-SW1-P10 


R1-S10-NIC2 


R1-SW1-P32 


R1-S11-SER 


R1-SW2-P11 


R1-S1 1-NIC1 


R1-SW1-P11 


R1-S11-NIC2 


R1-SW1-P33 


R1-S12-SER 


R1-SW2-P12 


R1-S12-NIC1 


R1-SW1-P12 


R1-S12-NIC2 


R1-SW1-P34 


R1-S13-SER 


R1-SW2-P13 


R1-S13-NIC1 


R1-SW1-P13 


R1-S13-NIC2 


R1-SW1-P35 
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16 Node GigE Expandable to 22 Nodes 



Table 3-2: 16 Node GigE Cabling for DL140 LC Clusters Expandable to 22 Nodes continued 



00B Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 


Origin (server) 


Destination 

Id HV ■ LVil I 1 


Origin (server) 


Destination 

1 0 *■ llWllJ 


R1-S14-SER 


R1-SW2-P14 


R1-S14-NIC1 


R1-SW1-P14 


R1-S14-NIC2 


R1-SW1-P36 


R1-S15-SER 


R1-SW2-P15 


R1-S15-NIC1 


R1-SW1-P15 


R1-S15-NIC2 


R1-SW1-P37 


R1-S16-SER 


R1-SW2-P16 


R1-S16-NIC1 


R1-SW1-P16 


R1-S16-NIC2 


R1-SW1-P38 


R1-S17-SER 


R1-SW2-P17 


R1-S17-NIC1 


R1-SW1-P17 


R1-S17-NIC2 


R1-SW1-P39 


R1-S18-SER 


R1-SW2-P18 


R1-S18-NIC1 


R1-SW1-P18 


R1-S18-NIC2 


R1-SW1-P40 


R1-S19-SER 


R1-SW2-P19 


R1-S19-NIC1 


R1-SW1-P19 


R1-S19-NIC2 


R1-SW1-P41 


R1-S20-SER 


R1-SW2-P20 


R1-S20-NIC1 


R1-SW1-P20 


R1-S20-NIC2 


R1-SW1-P42 


R1-S21-SER 


R1-SW2-P21 


R1-S21-NIC1 


R1-SW1-P21 


R1-S21-NIC2 


R1-SW1-P43 


R1-S22-SER 


R1-SW2-P22 


R1-S22-NIC1 


R1-SW1-P22 


R1-S22-NIC2 


R1-SW1-P44 


R1-S23-SER 


R1-SW2-P23 


N/A 


N/A 


R1-S23-NIC2 


R1-SW1-P45 



Table 3-3: 00B Management Switch Uplink 


From 


To 


R1-SW2-P48 


R1-SW1-P48 
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16 Node Fast Ethernet Expandable to 22 Nodes 



DL140 
Compute 
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16 Node Fast Ethernet Expandable to 22 Nodes 



Rack Diagram 

Rack 1 (R1) 
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16 Node Fast Ethernet Expandable to 22 Nodes 



Point-to-Point Cabling Guide 



Table 4-1 : Cable Label Nomenclature 


Symbol 


Description 


R 


Rack number 


S 


Control/Compute/Storage node number 


SW 


Out of Band (OOB) Management Switch/Cluster Interconnect Switch/In Band (IB) 
Management Switch number 


M 


Module letter or Module number 


P 


Port number 


NIC 


NIC port number 


SER 


Serial port 



Table 4-2: 16 Node Fast Ethernet Cabling for DL140 LC Clusters Expandable to 22 Nodes 


OOB Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R1-S1-SER 


R1-SW2-P1 


R1-S1-NIC1 


R1-SW1-P1 


R1-S1-NIC2 


R1-SW1-P25 


R1-S2-SER 


R1-SW2-P2 


R1-S2-NIC1 


R1-SW1-P2 


R1-S2-NIC2 


R1-SW1-P26 


R1-S3-SER 


R1-SW2-P3 


R1-S3-NIC1 


R1-SW1-P3 


R1-S3-NIC2 


R1-SW1-P27 


R1-S4-SER 


R1-SW2-P4 


R1-S4-NIC1 


R1-SW1-P4 


R1-S4-NIC2 


R1-SW1-P28 


R1-S5-SER 


R1-SW2-P5 


R1-S5-NIC1 


R1-SW1-P5 


R1-S5-NIC2 


R1-SW1-P29 


R1-S6-SER 


R1-SW2-P6 


R1-S6-NIC1 


R1-SW1-P6 


R1-S6-NIC2 


R1-SW1-P30 


R1-S7-SER 


R1-SW2-P7 


R1-S7-NIC1 


R1-SW1-P7 


R1-S7-NIC2 


R1-SW1-P31 


R1-S8-SER 


R1-SW2-P8 


R1-S8-NIC1 


R1-SW1-P8 


R1-S8-NIC2 


R1-SW1-P32 


R1-S9-SER 


R1-SW2-P9 


R1-S9-NIC1 


R1-SW1-P9 


R1-S9-NIC2 


R1-SW1-P33 


R1-S10-SER 


R1-SW2-P10 


R1-S10-NIC1 


R1-SW1-P10 


R1-S10-NIC2 


R1-SW1-P34 


R1-S11-SER 


R1-SW2-P11 


R1-S1 1-NIC1 


R1-SW1-P11 


R1-S11-NIC2 


R1-SW1-P35 


R1-S12-SER 


R1-SW2-P12 


R1-S12-NIC1 


R1-SW1-P12 


R1-S12-NIC2 


R1-SW1-P36 


R1-S13-SER 


R1-SW2-P13 


R1-S13-NIC1 


R1-SW1-P13 


R1-S13-NIC2 


R1-SW1-P37 
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16 Node Fast Ethernet Expandable to 22 Nodes 



Table 4-2: 16 Node Fast Ethernet Cabling for DL140 LC Clusters Expandable to 22 Nodes 

continued 



00B Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R1-S14-SER 


R1-SW2-P14 


R1-S14-NIC1 


R1-SW1-P14 


R1-S14-NIC2 


R1-SW1-P38 


R1-S15-SER 


R1-SW2-P15 


R1-S15-NIC1 


R1-SW1-P15 


R1-S15-NIC2 


R1-SW1-P39 


R1-S16-SER 


R1-SW2-P16 


R1-S16-NIC1 


R1-SW1-P16 


R1-S16-NIC2 


R1-SW1-P40 


R1-S17-SER 


R1-SW2-P17 


R1-S17-NIC1 


R1-SW1-P17 


R1-S17-NIC2 


R1-SW1-P41 


R1-S18-SER 


R1-SW2-P18 


R1-S18-NIC1 


R1-SW1-P18 


R1-S18-NIC2 


R1-SW1-P42 


R1-S19-SER 


R1-SW2-P19 


R1-S19-NIC1 


R1-SW1-P19 


R1-S19-NIC2 


R1-SW1-P43 


R1-S20-SER 


R1-SW2-P20 


R1-S20-NIC1 


R1-SW1-P20 


R1-S20-NIC2 


R1-SW1-P44 


R1-S21-SER 


R1-SW2-P21 


R1-S21-NIC1 


R1-SW1-P21 


R1-S21-NIC2 


R1-SW1-P45 


R1-S22-SER 


R1-SW2-P22 


R1-S22-NIC1 


R1-SW1-P22 


R1-S22-NIC2 


R1-SW1-P46 


R1-S23-SER 


R1-SW2-P23 


N/A 


N/A 


R1-S23-NIC2 


R1-SW1-P47 



Table 4-3: OOB Management Switch Uplink 


From 


To 


R1-SW2-P48 


R1-SW1-P48 
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24 Node Myrinet Expandable to 32 Nodes 
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24 Node Myrinet Expandable to 32 Nodes 



Rack Diagram 



Rack 1 (R1) 
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24 Node Myrinet Expandable to 32 Nodes 



Point-to-Point Cabling Guide 



Table 5-1 : Cable Label Nomenclature 


Symbol 


Description 


R 


Rack number 


S 


Control/Compute/Storage node number 


SW 


Out of Band (OOB) Management Switch/Cluster Interconnect Switch/In Band (IB) 
Management Switch number 


M 


Module letter or Module number 


P 


Port number 


NIC 


NIC port number 


SER 


Serial port 


PCI 


Myrinet Adapter (in PCI slot) 



Table 5-2: 24 Node Myrinet Cabling for DL140 LC Clusters Expandable to 32 Nodes 


OOB Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R1-S1-SER 


R1-SW3-P1 


R1-S1-PCI 


R1-SW1-M1-P8 


R1-S1-NIC2 


R1-SW2-P1 


R1-S2-SER 


R1-SW3-P2 


R1-S2-PCI 


R1-SW1-M1-P9 


R1-S2-NIC2 


R1-SW2-P2 


R1-S3-SER 


R1-SW3-P3 


R1-S3-PCI 


R1-SW1-M1-P10 


R1-S3-NIC2 


R1-SW2-P3 


R1-S4-SER 


R1-SW3-P4 


R1-S4-PCI 


R1-SW1-M1-P11 


R1-S4-NIC2 


R1-SW2-P4 


R1-S5-SER 


R1-SW3-P5 


R1-S5-PCI 


R1-SW1-M1-P12 


R1-S5-NIC2 


R1-SW2-P5 


R1-S6-SER 


R1-SW3-P6 


R1-S6-PCI 


R1-SW1-M1-P13 


R1-S6-NIC2 


R1-SW2-P6 


R1-S7-SER 


R1-SW3-P7 


R1-S7-PCI 


R1-SW1-M1-P14 


R1-S7-NIC2 


R1-SW2-P7 


R1-S8-SER 


R1-SW3-P8 


R1-S8-PCI 


R1-SW1-M1-P15 


R1-S8-NIC2 


R1-SW2-P8 


R1-S9-SER 


R1-SW3-P9 


R1-S9-PCI 


R1-SW1-M2-P8 


R1-S9-NIC2 


R1-SW2-P9 


R1-S10-SER 


R1-SW3-P10 


R1-S10-PCI 


R1-SW1-M2-P9 


R1-S10-NIC2 


R1-SW2-P10 


R1-S11-SER 


R1-SW3-P11 


R1-S11-PCI 


R1-SW1-M2-P10 


R1-S11-NIC2 


R1-SW2-P11 


R1-S12-SER 


R1-SW3-P12 


R1-S12-PCI 


R1-SW1-M2-P11 


R1-S12-NIC2 


R1-SW2-P12 


R1-S13-SER 


R1-SW3-P13 


R1-S13-PCI 


R1-SW1-M2-P12 


R1-S13-NIC2 


R1-SW2-P13 
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24 Node Myrinet Expandable to 32 Nodes 



Table 5-2: 24 Node Myrinet Cabling for DL140 LC Clusters Expandable to 32 Nodes continued 



00B Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 


Origin (server) 


Destination 

Id HV ■ LVil 1 1 


Origin (server) 


Destination 

1 0 ¥■ llWllJ 


R1-S14-SER 


R1-SW3-P14 


R1-S14-PCI 


R1-SW1-M2-P13 


R1-S14-NIC2 


R1-SW2-P14 


R1-S15-SER 


R1-SW3-P15 


R1-S15-PCI 


R1-SW1-M2-P14 


R1-S15-NIC2 


R1-SW2-P15 


R1-S16-SER 


R1-SW3-P16 


R1-S16-PCI 


R1-SW1-M2-P15 


R1-S16-NIC2 


R1-SW2-P16 


R1-S17-SER 


R1-SW3-P17 


R1-S17-PCI 


R1-SW1-M3-P8 


R1-S17-NIC2 


R1-SW2-P17 


R1-S18-SER 


R1-SW3-P18 


R1-S18-PCI 


R1-SW1-M3-P9 


R1-S18-NIC2 


R1-SW2-P18 


R1-S19-SER 


R1-SW3-P19 


R1-S19-PCI 


R1-SW1-M3-P10 


R1-S19-NIC2 


R1-SW2-P19 


R1-S20-SER 


R1-SW3-P20 


R1-S20-PCI 


R1-SW1-M3-P11 


R1-S20-NIC2 


R1-SW2-P20 


R1-S21-SER 


R1-SW3-P21 


R1-S21-PCI 


R1-SW1-M3-P12 


R1-S21-NIC2 


R1-SW2-P21 


R1-S22-SER 


R1-SW3-P22 


R1-S22-PCI 


R1-SW1-M3-P13 


R1-S22-NIC2 


R1-SW2-P22 


R1-S23-SER 


R1-SW3-P23 


N/A 


N/A 


R1-S23-NIC2 


R1-SW2-P23 


R1-S24-SER 


R1-SW3-P24 


R1-S24-PCI 


R1-SW1-M3-P14 


R1-S24-NIC2 


R1-SW2-P24 


R1-S25-SER 


R1-SW3-P25 


R1-S25-PCI 


R1-SW1-M3-P15 


R1-S25-NIC2 


R1-SW2-P25 


R1-S26-SER 


R1-SW3-P26 


R1-S26-PCI 


R1-SW1-M4-P8 


R1-S26-NIC2 


R1-SW2-P26 


R1-S27-SER 


R1-SW3-P27 


R1-S27-PCI 


R1-SW1-M4-P9 


R1-S27-NIC2 


R1-SW2-P27 


R1-S28-SER 


R1-SW3-P28 


R1-S28-PCI 


R1-SW1-M4-P10 


R1-S28-NIC2 


R1-SW2-P28 


R1-S29-SER 


R1-SW3-P29 


R1-S29-PCI 


R1-SW1-M4-P11 


R1-S29-NIC2 


R1-SW2-P29 


R1-S30-SER 


R1-SW3-P30 


R1-S30-PCI 


R1-SW1-M4-P12 


R1-S30-NIC2 


R1-SW2-P30 


R1-S31-SER 


R1-SW3-P31 


R1-S31-PCI 


R1-SW1-M4-P13 


R1-S31-NIC2 


R1-SW2-P31 


R1-S32-SER 


R1-SW3-P32 


R1-S32-PCI 


R1-SW1-M4-P14 


R1-S32-NIC2 


R1-SW2-P32 


R1-S33-SER 


R1-SW3-P33 


R1-S33-PCI 


R1-SW1-M4-P15 


R1-S33-NIC2 


R1-SW2-P33 



Table 5-3: Myricom Monitor 


From 


To 


R1-SW1-M5-P1 


R1-SW2-P47 



Table 5-4: 00B Management Switch Uplink 


From 


To 


R1-SW3-P48 


R1-SW2-P48 
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24 Node GigE Expandable to 36 Nodes 
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24 Node GigE Expandable to 36 Nodes 



Rack Diagram 



Rack 1 (R1) 
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24 Node GigE Expandable to 36 Nodes 



Point-to-Point Cabling Guide 



Table 6-1 : Cable Label Nomenclature 


Symbol 


Description 


R 


Rack number 


S 


Control/Compute/Storage node number 


SW 


Out of Band (OOB) Management Switch/Cluster Interconnect Switch/In Band (IB) 
Management Switch number 


M 


Module letter or Module number 


P 


Port number 


NIC 


NIC port number 


SER 


Serial port 



Table 6-2: 24 Node GigE Cabling for DL140 LC Clusters Expandable to 36 Nodes 


OOB Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R1-S1-SER 


R1-SW3-P1 


R1-S1-NIC1 


R1-SW1-P1 


R1-S1-NIC2 


R1-SW2-P1 


R1-S2-SER 


R1-SW3-P2 


R1-S2-NIC1 


R1-SW1-P2 


R1-S2-NIC2 


R1-SW2-P2 


R1-S3-SER 


R1-SW3-P3 


R1-S3-NIC1 


R1-SW1-P3 


R1-S3-NIC2 


R1-SW2-P3 


R1-S4-SER 


R1-SW3-P4 


R1-S4-NIC1 


R1-SW1-P4 


R1-S4-NIC2 


R1-SW2-P4 


R1-S5-SER 


R1-SW3-P5 


R1-S5-NIC1 


R1-SW1-P5 


R1-S5-NIC2 


R1-SW2-P5 


R1-S6-SER 


R1-SW3-P6 


R1-S6-NIC1 


R1-SW1-P6 


R1-S6-NIC2 


R1-SW2-P6 


R1-S7-SER 


R1-SW3-P7 


R1-S7-NIC1 


R1-SW1-P7 


R1-S7-NIC2 


R1-SW2-P7 


R1-S8-SER 


R1-SW3-P8 


R1-S8-NIC1 


R1-SW1-P8 


R1-S8-NIC2 


R1-SW2-P8 


R1-S9-SER 


R1-SW3-P9 


R1-S9-NIC1 


R1-SW1-P9 


R1-S9-NIC2 


R1-SW2-P9 


R1-S10-SER 


R1-SW3-P10 


R1-S10-NIC1 


R1-SW1-P10 


R1-S10-NIC2 


R1-SW2-P10 


R1-S11-SER 


R1-SW3-P11 


R1-S1 1-NIC1 


R1-SW1-P11 


R1-S11-NIC2 


R1-SW2-P11 


R1-S12-SER 


R1-SW3-P12 


R1-S12-NIC1 


R1-SW1-P12 


R1-S12-NIC2 


R1-SW2-P12 


R1-S13-SER 


R1-SW3-P13 


R1-S13-NIC1 


R1-SW1-P13 


R1-S13-NIC2 


R1-SW2-P13 



continued 



HP High Performance Clusters LC 1000 Series Cabling Guide 



6-3 



24 Node GigE Expandable to 36 Nodes 



Table 6-2: 24 Node GigE Cabling for DL140 LC Clusters Expandable to 36 Nodes continued 



00B Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 


Origin (server) 


Destination 

Id HV ■ LVil I 1 


Origin (server) 


Destination 

1 O ¥■ 1 IV* 1 1 J 


R1-S14-SER 


R1-SW3-P14 


R1-S14-NIC1 


R1-SW1-P14 


R1-S14-NIC2 


R1-SW2-P14 


R1-S15-SER 


R1-SW3-P15 


R1-S15-NIC1 


R1-SW1-P15 


R1-S15-NIC2 


R1-SW2-P15 


R1-S16-SER 


R1-SW3-P16 


R1-S16-NIC1 


R1-SW1-P16 


R1-S16-NIC2 


R1-SW2-P16 


R1-S17-SER 


R1-SW3-P17 


R1-S17-NIC1 


R1-SW1-P17 


R1-S17-NIC2 


R1-SW2-P17 


R1-S18-SER 


R1-SW3-P18 


R1-S18-NIC1 


R1-SW1-P18 


R1-S18-NIC2 


R1-SW2-P18 


R1-S19-SER 


R1-SW3-P19 


R1-S19-NIC1 


R1-SW1-P19 


R1-S19-NIC2 


R1-SW2-P19 


R1-S20-SER 


R1-SW3-P20 


R1-S20-NIC1 


R1-SW1-P20 


R1-S20-NIC2 


R1-SW2-P20 


R1-S21-SER 


R1-SW3-P21 


R1-S21-NIC1 


R1-SW1-P21 


R1-S21-NIC2 


R1-SW2-P21 


R1-S22-SER 


R1-SW3-P22 


R1-S22-NIC1 


R1-SW1-P22 


R1-S22-NIC2 


R1-SW2-P22 


R1-S23-SER 


R1-SW3-P23 


R1-S23-NIC1 


R1-SW1-P23 


R1-S23-NIC2 


R1-SW2-P23 


R1-S24-SER 


R1-SW3-P24 


R1-S24-NIC1 


R1-SW1-P24 


R1-S24-NIC2 


R1-SW2-P24 


R1-S25-SER 


R1-SW3-P25 


N/A 


N/A 


R1-S25-NIC2 


R1-SW2-P25 


R1-S26-SER 


R1-SW3-P26 


R1-S26-NIC1 


R1-SW1-P25 


R1-S26-NIC2 


R1-SW2-P26 


R1-S27-SER 


R1-SW3-P27 


R1-S27-NIC1 


R1-SW1-P26 


R1-S27-NIC2 


R1-SW2-P27 


R1-S28-SER 


R1-SW3-P28 


R1-S28-NIC1 


R1-SW1-P27 


R1-S28-NIC2 


R1-SW2-P28 


R1-S29-SER 


R1-SW3-P29 


R1-S29-NIC1 


R1-SW1-P28 


R1-S29-NIC2 


R1-SW2-P29 


R1-S30-SER 


R1-SW3-P30 


R1-S30-NIC1 


R1-SW1-P29 


R1-S30-NIC2 


R1-SW2-P30 


R1-S31-SER 


R1-SW3-P31 


R1-S31-NIC1 


R1-SW1-P30 


R1-S31-NIC2 


R1-SW2-P31 


R1-S32-SER 


R1-SW3-P32 


R1-S32-NIC1 


R1-SW1-P31 


R1-S32-NIC2 


R1-SW2-P32 


R1-S33-SER 


R1-SW3-P33 


R1-S33-NIC1 


R1-SW1-P32 


R1-S33-NIC2 


R1-SW2-P33 


R1-S34-SER 


R1-SW3-P34 


R1-S34-NIC1 


R1-SW1-P33 


R1-S34-NIC2 


R1-SW2-P34 


R1-S35-SER 


R1-SW3-P35 


R1-S35-NIC1 


R1-SW1-P34 


R1-S35-NIC2 


R1-SW2-P35 


R1-S36-SER 


R1-SW3-P36 


R1-S36-NIC1 


R1-SW1-P35 


R1-S36-NIC2 


R1-SW2-P36 


R1-S37-SER 


R1-SW3-P37 


R1-S37-NIC1 


R1-SW1-P36 


R1-S37-NIC2 


R1-SW2-P37 



Table 6-3: 00B Management Switch Uplink 


From 


To 


R1-SW3-P48 


R1-SW2-P48 
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24 Node Fast Ethernet Expandable to 36 Nodes 



DL140 
Compute 
Node 



DL140 
Compute 
Node 



DL380 
Control 
Node 




iLO 
NIC2 
NIC1 
Serial 
SCSI 2 
SCSI 1 



Public LAN 



HP High Performance Clusters LC 1000 Series Cabling Guide 



7-1 



24 Node Fast Ethernet Expandable to 36 Nodes 



Rack Diagram 



Rack 1 (R1) 



A /"I 

42 


S37 


Expansion 


41 


S36 


Expansion 


A /"\ 

40 


S35 


Expansion 


ot? 


S34 


Expansion 


oo 
oo 


coo 
boo 


Expansion 


37 


S32 


Expansion 


36 


S31 


Expansion 


35 


S30 


Expansion 


34 


S29 


Expansion 


33 


S28 


Expansion 


32 


S27 


Expansion 


31 


S26 


Expansion 


30 






29 


28 


S24 


DL140 


27 


S23 


DL140 


26 


S22 


DL140 


25 


S21 


DL140 


24 


S20 


DL140 


23 


S19 


DL140 


22 
21 








20 


TFT5600 


19 


SW1 


ProCurve 2650 


18 


S18 


DL140 


17 


S17 


DL140 


16 


S16 


DL140 


15 


S15 


DL140 


14 


S14 


DL140 


13 


S13 


DL140 


12 


S12 


DL140 


11 


S11 


DL140 


10 


S10 


DL140 


9 


S9 


DL140 


8 


S8 


DL140 


7 


S7 


DL140 


6 


S6 


DL140 


5 


S5 


DL140 


4 


S4 


DL140 


3 


S3 


DL140 


2 
1 


S2 


DL140 
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24 Node Fast Ethernet Expandable to 36 Nodes 



Point-to-Point Cabling Guide 



Table 7-1 : Cable Label Nomenclature 


Symbol 


Description 


R 


Rack number 


S 


Control/Compute/Storage node number 


SW 


Out of Band (OOB) Management Switch/Cluster Interconnect Switch/In Band (IB) 
Management Switch number 


M 


Module letter or Module number 


P 


Port number 


NIC 


NIC port number 


SER 


Serial port 



Table 7-2: 24 Node Fast Ethernet Cabling for DL140 LC Clusters Expandable to 36 Nodes 


OOB Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R1-S1-SER 


R1-SW3-P1 


R1-S1-NIC1 


R1-SW1-P1 


R1-S1-NIC2 


R1-SW2-P1 


R1-S2-SER 


R1-SW3-P2 


R1-S2-NIC1 


R1-SW1-P2 


R1-S2-NIC2 


R1-SW2-P2 


R1-S3-SER 


R1-SW3-P3 


R1-S3-NIC1 


R1-SW1-P3 


R1-S3-NIC2 


R1-SW2-P3 


R1-S4-SER 


R1-SW3-P4 


R1-S4-NIC1 


R1-SW1-P4 


R1-S4-NIC2 


R1-SW2-P4 


R1-S5-SER 


R1-SW3-P5 


R1-S5-NIC1 


R1-SW1-P5 


R1-S5-NIC2 


R1-SW2-P5 


R1-S6-SER 


R1-SW3-P6 


R1-S6-NIC1 


R1-SW1-P6 


R1-S6-NIC2 


R1-SW2-P6 


R1-S7-SER 


R1-SW3-P7 


R1-S7-NIC1 


R1-SW1-P7 


R1-S7-NIC2 


R1-SW2-P7 


R1-S8-SER 


R1-SW3-P8 


R1-S8-NIC1 


R1-SW1-P8 


R1-S8-NIC2 


R1-SW2-P8 


R1-S9-SER 


R1-SW3-P9 


R1-S9-NIC1 


R1-SW1-P9 


R1-S9-NIC2 


R1-SW2-P9 


R1-S10-SER 


R1-SW3-P10 


R1-S10-NIC1 


R1-SW1-P10 


R1-S10-NIC2 


R1-SW2-P10 


R1-S11-SER 


R1-SW3-P11 


R1-S1 1-NIC1 


R1-SW1-P11 


R1-S11-NIC2 


R1-SW2-P11 


R1-S12-SER 


R1-SW3-P12 


R1-S12-NIC1 


R1-SW1-P12 


R1-S12-NIC2 


R1-SW2-P12 


R1-S13-SER 


R1-SW3-P13 


R1-S13-NIC1 


R1-SW1-P13 


R1-S13-NIC2 


R1-SW2-P13 
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24 Node Fast Ethernet Expandable to 36 Nodes 



Table 7-2: 24 Node Fast Ethernet Cabling for DL140 LC Clusters Expandable to 36 Nodes 

continued 



00B Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R1-S14-SER 


R1-SW3-P14 


R1-S14-NIC1 


R1-SW1-P14 


R1-S14-NIC2 


R1-SW2-P14 


R1-S15-SER 


R1-SW3-P15 


R1-S15-NIC1 


R1-SW1-P15 


R1-S15-NIC2 


R1-SW2-P15 


R1-S16-SER 


R1-SW3-P16 


R1-S16-NIC1 


R1-SW1-P16 


R1-S16-NIC2 


R1-SW2-P16 


R1-S17-SER 


R1-SW3-P17 


R1-S17-NIC1 


R1-SW1-P17 


R1-S17-NIC2 


R1-SW2-P17 


R1-S18-SER 


R1-SW3-P18 


R1-S18-NIC1 


R1-SW1-P18 


R1-S18-NIC2 


R1-SW2-P18 


R1-S19-SER 


R1-SW3-P19 


R1-S19-NIC1 


R1-SW1-P19 


R1-S19-NIC2 


R1-SW2-P19 


R1-S20-SER 


R1-SW3-P20 


R1-S20-NIC1 


R1-SW1-P20 


R1-S20-NIC2 


R1-SW2-P20 


R1-S21-SER 


R1-SW3-P21 


R1-S21-NIC1 


R1-SW1-P21 


R1-S21-NIC2 


R1-SW2-P21 


R1-S22-SER 


R1-SW3-P22 


R1-S22-NIC1 


R1-SW1-P22 


R1-S22-NIC2 


R1-SW2-P22 


R1-S23-SER 


R1-SW3-P23 


R1-S23-NIC1 


R1-SW1-P23 


R1-S23-NIC2 


R1-SW2-P23 


R1-S24-SER 


R1-SW3-P24 


R1-S24-NIC1 


R1-SW1-P24 


R1-S24-NIC2 


R1-SW2-P24 


R1-S25-SER 


R1-SW3-P25 


N/A 


N/A 


R1-S25-NIC2 


R1-SW2-P25 


R1-S26-SER 


R1-SW3-P26 


R1-S26-NIC1 


R1-SW1-P25 


R1-S26-NIC2 


R1-SW2-P26 


R1-S27-SER 


R1-SW3-P27 


R1-S27-NIC1 


R1-SW1-P26 


R1-S27-NIC2 


R1-SW2-P27 


R1-S28-SER 


R1-SW3-P28 


R1-S28-NIC1 


R1-SW1-P27 


R1-S28-NIC2 


R1-SW2-P28 


R1-S29-SER 


R1-SW3-P29 


R1-S29-NIC1 


R1-SW1-P28 


R1-S29-NIC2 


R1-SW2-P29 


R1-S30-SER 


R1-SW3-P30 


R1-S30-NIC1 


R1-SW1-P29 


R1-S30-NIC2 


R1-SW2-P30 


R1-S31-SER 


R1-SW3-P31 


R1-S31-NIC1 


R1-SW1-P30 


R1-S31-NIC2 


R1-SW2-P31 


R1-S32-SER 


R1-SW3-P32 


R1-S32-NIC1 


R1-SW1-P31 


R1-S32-NIC2 


R1-SW2-P32 


R1-S33-SER 


R1-SW3-P33 


R1-S33-NIC1 


R1-SW1-P32 


R1-S33-NIC2 


R1-SW2-P33 


R1-S34-SER 


R1-SW3-P34 


R1-S34-NIC1 


R1-SW1-P33 


R1-S34-NIC2 


R1-SW2-P34 


R1-S35-SER 


R1-SW3-P35 


R1-S35-NIC1 


R1-SW1-P34 


R1-S35-NIC2 


R1-SW2-P35 


R1-S36-SER 


R1-SW3-P36 


R1-S36-NIC1 


R1-SW1-P35 


R1-S36-NIC2 


R1-SW2-P36 


R1-S37-SER 


R1-SW3-P37 


R1-S37-NIC1 


R1-SW1-P36 


R1-S37-NIC2 


R1-SW2-P37 



Table 7-3: OOB Management Switch Uplink 


From 


To 


R1-SW3-P48 


R1-SW2-P48 
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32 Node Myrinet Expandable to 64 Nodes 



Myr ■ 

DL140 NIC1 . 

Compute N| C2- 

m Serial " 

Node ATA 2 ■ 



• 




• 




• 




Myr — 


DL140 


NIC1 - 


Compute 


NIC2- 
Serial — 


Node 


ATA 2 — 



E 

ID CD 
CD O) . 

Mural 

}■=! 

SI" 




co S 

■d" O W 

CO O *j 

CM O c 

5 >o E 



at 



Myr ■ 

DL140 NIC1 . 



Compute 



NIC2 ■ 
Serial • 

Node ATA 2 • 

ATA 1 



Myr 



DL140 NIC1 . 
Compute Nl02 ' 

M -J Serial ' 

Node ATA 2 ■ 

ATA 1 • 



DL380 nic2 • 
Control NIC1 - 

Serial • 
SCSI 2 ■ 



Node 



_SCSM 



a > a 1 1 




5 — C - 




O W 
CO O « 
CM O C 

g > o E 



Public LAh 
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32 Node Myrinet Expandable to 64 Nodes 



Rack Diagram 



Rack 1 (R1) 



42 


S33 


DL140 


41 


S32 


DL140 


40 


S31 


DL140 


39 


S30 


DL140 


38 


S29 


DL140 


37 


S28 


DL140 


36 


S27 


DL140 


35 


S26 


DL140 


34 


S25 


DL140 


33 


S24 


DL140 


32 


S23 


DL140 


31 


S22 


DL140 


30 






29 






28 


"§20 


DL140 


27 


S19 


DL140 


26 


S18 


DL140 


25 


S17 


DL140 


24 


S16 


DL140 


23 


S15 


DL140 


22 


SW3 


Cyclades 


21 


SW2 


ProCurve 2848 


20 


TFT5600 


19 


S14 


DL140 


18 


S13 


DL140 


17 


S12 


DL140 


16 


S11 


DL140 


15 


S10 


DL140 


14 


S9 


DL140 


1o 


S8 


DL140 


12 


S7 


DL140 


11 


S6 


DL140 


10 


S5 


DL140 


9 


S4 


DL140 


8 


S3 


DL140 


7 


S2 


DL140 


6 


S1 


DL140 


5 




Myricom 


4 


SW1 


9 slot chassis 


3 
2 


w/Myrinet 



Rack 2 (R2) 



















S32 


Expansion 


S31 


Expansion 


S30 


Expansion 


S29 


Expansion 


S28 


Expansion 


S27 


Expansion 


S26 


Expansion 


S25 


Expansion 


S24 


Expansion 


S23 


Expansion 


S22 


Expansion 


S21 


Expansion 


SW2 


Expansion 


SW1 


Expansion 


S20 


Expansion 


S19 


Expansion 


S18 


Expansion 


S17 


Expansion 


S16 


Expansion 


S15 


Expansion 


S14 


Expansion 


S13 


Expansion 


S12 


Expansion 


S11 


Expansion 


S10 


Expansion 


S9 


Expansion 


S8 


Expansion 


S7 


Expansion 


S6 


Expansion 


S5 


Expansion 


S4 


Expansion 


S3 


Expansion 


S2 


Expansion 


S1 


Expansion 
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32 Node Myrinet Expandable to 64 Nodes 



Point-to-Point Cabling Guide 



Table 8-1 : Cable Label Nomenclature 


Symbol 


Description 


R 


Rack number 


S 


Control/Compute/Storage node number 


SW 


Out of Band (OOB) Management Switch/Cluster Interconnect Switch/In Band (IB) 
Management Switch number 


M 


Module letter or Module number 


P 


Port number 


NIC 


NIC port number 


SER 


Serial port 


PCI 


Myrinet Adapter (in PCI slot) 



Table 8-2: 32 Node Myrinet Cabling for DL140 LC Clusters Expandable to 64 Nodes 


OOB Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R1-S1-SER 


R1-SW3-P1 


R1-S1-PCI 


R1-SW1-M1-P8 


R1-S1-NIC2 


R1-SW2-P1 


R1-S2-SER 


R1-SW3-P2 


R1-S2-PCI 


R1-SW1-M1-P9 


R1-S2-NIC2 


R1-SW2-P2 


R1-S3-SER 


R1-SW3-P3 


R1-S3-PCI 


R1-SW1-M1-P10 


R1-S3-NIC2 


R1-SW2-P3 


R1-S4-SER 


R1-SW3-P4 


R1-S4-PCI 


R1-SW1-M1-P11 


R1-S4-NIC2 


R1-SW2-P4 


R1-S5-SER 


R1-SW3-P5 


R1-S5-PCI 


R1-SW1-M1-P12 


R1-S5-NIC2 


R1-SW2-P5 


R1-S6-SER 


R1-SW3-P6 


R1-S6-PCI 


R1-SW1-M1-P13 


R1-S6-NIC2 


R1-SW2-P6 


R1-S7-SER 


R1-SW3-P7 


R1-S7-PCI 


R1-SW1-M1-P14 


R1-S7-NIC2 


R1-SW2-P7 


R1-S8-SER 


R1-SW3-P8 


R1-S8-PCI 


R1-SW1-M1-P15 


R1-S8-NIC2 


R1-SW2-P8 


R1-S9-SER 


R1-SW3-P9 


R1-S9-PCI 


R1-SW1-M2-P8 


R1-S9-NIC2 


R1-SW2-P9 


R1-S10-SER 


R1-SW3-P10 


R1-S10-PCI 


R1-SW1-M2-P9 


R1-S10-NIC2 


R1-SW2-P10 


R1-S11-SER 


R1-SW3-P11 


R1-S11-PCI 


R1-SW1-M2-P10 


R1-S11-NIC2 


R1-SW2-P11 


R1-S12-SER 


R1-SW3-P12 


R1-S12-PCI 


R1-SW1-M2-P11 


R1-S12-NIC2 


R1-SW2-P12 


R1-S13-SER 


R1-SW3-P13 


R1-S13-PCI 


R1-SW1-M2-P12 


R1-S13-NIC2 


R1-SW2-P13 
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32 Node Myrinet Expandable to 64 Nodes 



Table 8-2: 32 Node Myrinet Cabling for DL140 LC Clusters Expandable to 64 Nodes continued 



00B Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 


Origin (server) 


Destination 

Id HV ■ LVil 1 1 


Origin (server) 


Destination 

1 0 ¥■ llWllJ 


R1-S14-SER 


R1-SW3-P14 


R1-S14-PCI 


R1-SW1-M2-P13 


R1-S14-NIC2 


R1-SW2-P14 


R1-S15-SER 


R1-SW3-P15 


R1-S15-PCI 


R1-SW1-M2-P14 


R1-S15-NIC2 


R1-SW2-P15 


R1-S16-SER 


R1-SW3-P16 


R1-S16-PCI 


R1-SW1-M2-P15 


R1-S16-NIC2 


R1-SW2-P16 


R1-S17-SER 


R1-SW3-P17 


R1-S17-PCI 


R1-SW1-M3-P8 


R1-S17-NIC2 


R1-SW2-P17 


R1-S18-SER 


R1-SW3-P18 


R1-S18-PCI 


R1-SW1-M3-P9 


R1-S18-NIC2 


R1-SW2-P18 


R1-S19-SER 


R1-SW3-P19 


R1-S19-PCI 


R1-SW1-M3-P10 


R1-S19-NIC2 


R1-SW2-P19 


R1-S20-SER 


R1-SW3-P20 


R1-S20-PCI 


R1-SW1-M3-P11 


R1-S20-NIC2 


R1-SW2-P20 


R1-S21-SER 


R1-SW3-P21 


N/A 


N/A 


R1-S21-NIC2 


R1-SW2-P21 


R1-S22-SER 


R1-SW3-P22 


R1-S22-PCI 


R1-SW1-M3-P12 


R1-S22-NIC2 


R1-SW2-P22 


R1-S23-SER 


R1-SW3-P23 


R1-S23-PCI 


R1-SW1-M3-P13 


R1-S23-NIC2 


R1-SW2-P23 


R1-S24-SER 


R1-SW3-P24 


R1-S24-PCI 


R1-SW1-M3-P14 


R1-S24-NIC2 


R1-SW2-P24 


R1-S25-SER 


R1-SW3-P25 


R1-S25-PCI 


R1-SW1-M3-P15 


R1-S25-NIC2 


R1-SW2-P25 


R1-S26-SER 


R1-SW3-P26 


R1-S26-PCI 


R1-SW1-M4-P8 


R1-S26-NIC2 


R1-SW2-P26 


R1-S27-SER 


R1-SW3-P27 


R1-S27-PCI 


R1-SW1-M4-P9 


R1-S27-NIC2 


R1-SW2-P27 


R1-S28-SER 


R1-SW3-P28 


R1-S28-PCI 


R1-SW1-M4-P10 


R1-S28-NIC2 


R1-SW2-P28 


R1-S29-SER 


R1-SW3-P29 


R1-S29-PCI 


R1-SW1-M4-P11 


R1-S29-NIC2 


R1-SW2-P29 


R1-S30-SER 


R1-SW3-P30 


R1-S30-PCI 


R1-SW1-M4-P12 


R1-S30-NIC2 


R1-SW2-P30 


R1-S31-SER 


R1-SW3-P31 


R1-S31-PCI 


R1-SW1-M4-P13 


R1-S31-NIC2 


R1-SW2-P31 


R1-S32-SER 


R1-SW3-P32 


R1-S32-PCI 


R1-SW1-M4-P14 


R1-S32-NIC2 


R1-SW2-P32 


R1-S33-SER 


R1-SW3-P33 


R1-S33-PCI 


R1-SW1-M4-P15 


R1-S33-NIC2 


R1-SW2-P33 


R2-S1-SER 


R2-SW2-P1 


R2-S1-PCI 


R1-SW1-M5-P8 


R2-S1-NIC2 


R2-SW1-P1 


R2-S2-SER 


R2-SW2-P2 


R2-S2-PCI 


R1-SW1-M5-P9 


R2-S2-NIC2 


R2-SW1-P2 


R2-S3-SER 


R2-SW2-P3 


R2-S3-PCI 


R1-SW1-M5-P10 


R2-S3-NIC2 


R2-SW1-P3 


R2-S4-SER 


R2-SW2-P4 


R2-S4-PCI 


R1-SW1-M5-P11 


R2-S4-NIC2 


R2-SW1-P4 


R2-S5-SER 


R2-SW2-P5 


R2-S5-PCI 


R1-SW1-M5-P12 


R2-S5-NIC2 


R2-SW1-P5 


R2-S6-SER 


R2-SW2-P6 


R2-S6-PCI 


R1-SW1-M5-P13 


R2-S6-NIC2 


R2-SW1-P6 


R2-S7-SER 


R2-SW2-P7 


R2-S7-PCI 


R1-SW1-M5-P14 


R2-S7-NIC2 


R2-SW1-P7 


R2-S8-SER 


R2-SW2-P8 


R2-S8-PCI 


R1-SW1-M5-P15 


R2-S8-NIC2 


R2-SW1-P8 


R2-S9-SER 


R2-SW2-P9 


R2-S9-PCI 


R1-SW1-M6-P8 


R2-S9-NIC2 


R2-SW1-P9 


R2-S10-SER 


R2-SW2-P10 


R2-S10-PCI 


R1-SW1-M6-P9 


R2-S10-NIC2 


R2-SW1-P10 
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Table 8-2: 32 Node Myrinet Cabling for DL140 LC Clusters Expandable to 64 Nodes continued 



00B Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 


Origin (server) 


Destination 

y O HV ■ LVil 1 1 


Origin (server) 


Destination 

1 W V¥ HVfllJ 


R2-S1 1-SER 


R2-SW2-P1 1 


R2-S11-PCI 


R1-SW1-M6-P10 


R2-S1 1-NIC2 


R2-SW1-P11 


R2-S12-SER 


R2-SW2-P12 


R2-S12-PCI 


R1-SW1-M6-P11 


R2-S12-NIC2 


R2-SW1-P12 


R2-S13-SER 


R2-SW2-P13 


R2-S13-PCI 


R1-SW1-M6-P12 


R2-S13-NIC2 


R2-SW1-P13 


R2-S14-SER 


R2-SW2-P14 


R2-S14-PCI 


R1-SW1-M6-P13 


R2-S14-NIC2 


R2-SW1-P14 


R2-S15-SER 


R2-SW2-P15 


R2-S15-PCI 


R1-SW1-M6-P14 


R2-S15-NIC2 


R2-SW1-P15 


R2-S16-SER 


R2-SW2-P16 


R2-S16-PCI 


R1-SW1-M6-P15 


R2-S16-NIC2 


R2-SW1-P16 


R2-S17-SER 


R2-SW2-P17 


R2-S17-PCI 


R1-SW1-M7-P8 


R2-S17-NIC2 


R2-SW1-P17 


R2-S18-SER 


R2-SW2-P18 


R2-S18-PCI 


R1-SW1-M7-P9 


R2-S18-NIC2 


R2-SW1-P18 


R2-S19-SER 


R2-SW2-P19 


R2-S19-PCI 


R1-SW1-M7-P10 


R2-S19-NIC2 


R2-SW1-P19 


R2-S20-SER 


R2-SW2-P20 


R2-S20-PCI 


R1-SW1-M7-P11 


R2-S20-NIC2 


R2-SW1-P20 


R2-S21-SER 


R2-SW2-P21 


R2-S21-PCI 


R1-SW1-M7-P12 


R2-S21-NIC2 


R2-SW1-P21 


R2-S22-SER 


R2-SW2-P22 


R2-S22-PCI 


R1-SW1-M7-P13 


R2-S22-NIC2 


R2-SW1-P22 


R2-S23-SER 


R2-SW2-P23 


R2-S23-PCI 


R1-SW1-M7-P14 


R2-S23-NIC2 


R2-SW1-P23 


R2-S24-SER 


R2-SW2-P24 


R2-S24-PCI 


R1-SW1-M7-P15 


R2-S24-NIC2 


R2-SW1-P24 


R2-S25-SER 


R2-SW2-P25 


R2-S25-PCI 


R1-SW1-M8-P8 


R2-S25-NIC2 


R2-SW1-P25 


R2-S26-SER 


R2-SW2-P26 


R2-S26-PCI 


R1-SW1-M8-P9 


R2-S26-NIC2 


R2-SW1-P26 


R2-S27-SER 


R2-SW2-P27 


R2-S27-PCI 


R1-SW1-M8-P10 


R2-S27-NIC2 


R2-SW1-P27 


R2-S28-SER 


R2-SW2-P28 


R2-S28-PCI 


R1-SW1-M8-P11 


R2-S28-NIC2 


R2-SW1-P28 


R2-S29-SER 


R2-SW2-P29 


R2-S29-PCI 


R1-SW1-M8-P12 


R2-S29-NIC2 


R2-SW1-P29 


R2-S30-SER 


R2-SW2-P30 


R2-S30-PCI 


R1-SW1-M8-P13 


R2-S30-NIC2 


R2-SW1-P30 


R2-S31-SER 


R2-SW2-P31 


R2-S31-PCI 


R1-SW1-M8-P14 


R2-S31-NIC2 


R2-SW1-P31 


R2-S32-SER 


R2-SW2-P32 


R2-S32-PCI 


R1-SW1-M8-P15 


R2-S32-NIC2 


R2-SW1-P32 



Table 8-3: Myricom Monitor 


From 


To 


R1-SW1-M9-P1 


R1-SW2-P47 



Table 8-4: 00B Management Switch Uplink 


From 


To 


R1-SW3-P48 


R1-SW2-P48 


R2-SW2-P48 


R2-SW1-P48 
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Table 8-5: IB Management Switch Uplink 


From 


To 




R1-SW2-P46 


R2-SW1-P47 


Trunked together 


R1-SW2-P45 


R2-SW1-P46 


R1-SW2-P44 


R2-SW1-P45 


R1-SW2-P43 


R2-SW1-P44 
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Rack Diagram 



Rack 1 (R1) 



42 


S33 


DL140 


41 


S32 


DL140 


40 


S31 


DL140 


39 


S30 


DL140 


38 


S29 


DL140 


37 


S28 


DL140 


36 


S27 


DL140 


35 


S26 


DL140 


34 


S25 


DL140 


33 


S24 


DL140 


32 


S23 


DL140 


31 


S22 


DL140 


30 
29 


S21 DL380 


28 


S20 


DL140 


27 


S19 


DL140 


26 


S18 


DL140 


25 


S17 


DL140 


24 


S16 


DL140 


23 


S15 


DL140 


22 


SW3 


Cyclades 


21 


SW2 


ProCurve 2848 


20 


TFT5600 


19 


S14 


DL140 


18 


S13 


DL140 


17 


S12 


DL140 


16 


S11 


DL140 


15 


S10 


DL140 


14 


S9 


DL140 


13 


S8 


DL140 


12 


S7 


DL140 


11 


S6 


DL140 


10 


S5 


DL140 


9 


S4 


DL140 


8 


S3 


DL140 


7 


S2 


DL140 


6 


S1 


DL140 


5 
4 

3 
2 


SW1 


Myricom 
9 slot chassis 
w/GigE 


1 







Rack 2 (R2) 



















S32 


Expansion 


S31 


Expansion 


S30 


Expansion 


S29 


Expansion 


S28 


Expansion 


S27 


Expansion 


S26 


Expansion 


S25 


Expansion 


S24 


Expansion 


S23 


Expansion 


S22 


Expansion 


S21 


Expansion 






SW1 


Expansion 


S20 


Expansion 


S19 


Expansion 


S18 


Expansion 


S17 


Expansion 


S16 


Expansion 


S15 


Expansion 


S14 


Expansion 


S13 


Expansion 


S12 


Expansion 


S11 


Expansion 


S10 


Expansion 


S9 


Expansion 


S8 


Expansion 


S7 


Expansion 


S6 


Expansion 


S5 


Expansion 


S4 


Expansion 


S3 


Expansion 


S2 


Expansion 


S1 


Expansion 
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Table 9-1 : Cable Label Nomenclature 


Symbol 


Description 


R 


Rack number 


S 


Control/Compute/Storage node number 


SW 


Out of Band (OOB) Management Switch/Cluster Interconnect Switch/In Band (IB) 
Management Switch number 


M 


Module letter or Module number 


P 


Port number 


NIC 


NIC port number 


SER 


Serial port 



Table 9-2: 32 Node GigE Cabling for DL140 LC Clusters Expandable to 64 Nodes 


OOB Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R1-S1-SER 


R1-SW3-P1 


R1-S1-NIC1 


R1-SW1-M1-P8 


R1-S1-NIC2 


R1-SW2-P1 


R1-S2-SER 


R1-SW3-P2 


R1-S2-NIC1 


R1-SW1-M1-P9 


R1-S2-NIC2 


R1-SW2-P2 


R1-S3-SER 


R1-SW3-P3 


R1-S3-NIC1 


R1-SW1-M1-P10 


R1-S3-NIC2 


R1-SW2-P3 


R1-S4-SER 


R1-SW3-P4 


R1-S4-NIC1 


R1-SW1-M1-P11 


R1-S4-NIC2 


R1-SW2-P4 


R1-S5-SER 


R1-SW3-P5 


R1-S5-NIC1 


R1-SW1-M1-P12 


R1-S5-NIC2 


R1-SW2-P5 


R1-S6-SER 


R1-SW3-P6 


R1-S6-NIC1 


R1-SW1-M1-P13 


R1-S6-NIC2 


R1-SW2-P6 


R1-S7-SER 


R1-SW3-P7 


R1-S7-NIC1 


R1-SW1-M1-P14 


R1-S7-NIC2 


R1-SW2-P7 


R1-S8-SER 


R1-SW3-P8 


R1-S8-NIC1 


R1-SW1-M1-P15 


R1-S8-NIC2 


R1-SW2-P8 


R1-S9-SER 


R1-SW3-P9 


R1-S9-NIC1 


R1-SW1-M2-P8 


R1-S9-NIC2 


R1-SW2-P9 


R1-S10-SER 


R1-SW3-P10 


R1-S10-NIC1 


R1-SW1-M2-P9 


R1-S10-NIC2 


R1-SW2-P10 


R1-S11-SER 


R1-SW3-P11 


R1-S1 1-NIC1 


R1-SW1-M2-P10 


R1-S11-NIC2 


R1-SW2-P11 


R1-S12-SER 


R1-SW3-P12 


R1-S12-NIC1 


R1-SW1-M2-P11 


R1-S12-NIC2 


R1-SW2-P12 


R1-S13-SER 


R1-SW3-P13 


R1-S13-NIC1 


R1-SW1-M2-P12 


R1-S13-NIC2 


R1-SW2-P13 
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Table 9-2: 32 Node GigE Cabling for DL140 LC Clusters Expandable to 64 Nodes continued 



00B Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 


Origin (server) 


Destination 

Id HV ■ LVil 1 1 


Origin (server) 


Destination 

1 O ¥■ llWllJ 


R1-S14-SER 


R1-SW3-P14 


R1-S14-NIC1 


R1-SW1-M2-P13 


R1-S14-NIC2 


R1-SW2-P14 


R1-S15-SER 


R1-SW3-P15 


R1-S15-NIC1 


R1-SW1-M2-P14 


R1-S15-NIC2 


R1-SW2-P15 


R1-S16-SER 


R1-SW3-P16 


R1-S16-NIC1 


R1-SW1-M2-P15 


R1-S16-NIC2 


R1-SW2-P16 


R1-S17-SER 


R1-SW3-P17 


R1-S17-NIC1 


R1-SW1-M3-P8 


R1-S17-NIC2 


R1-SW2-P17 


R1-S18-SER 


R1-SW3-P18 


R1-S18-NIC1 


R1-SW1-M3-P9 


R1-S18-NIC2 


R1-SW2-P18 


R1-S19-SER 


R1-SW3-P19 


R1-S19-NIC1 


R1-SW1-M3-P10 


R1-S19-NIC2 


R1-SW2-P19 


R1-S20-SER 


R1-SW3-P20 


R1-S20-NIC1 


R1-SW1-M3-P1 1 


R1-S20-NIC2 


R1-SW2-P20 


R1-S21-SER 


R1-SW3-P21 


N/A 


N/A 


R1-S21-NIC2 


R1-SW2-P21 


R1-S22-SER 


R1-SW3-P22 


R1-S22-NIC1 


R1-SW1-M3-P12 


R1-S22-NIC2 


R1-SW2-P22 


R1-S23-SER 


R1-SW3-P23 


R1-S23-NIC1 


R1-SW1-M3-P13 


R1-S23-NIC2 


R1-SW2-P23 


R1-S24-SER 


R1-SW3-P24 


R1-S24-NIC1 


R1-SW1-M3-P14 


R1-S24-NIC2 


R1-SW2-P24 


R1-S25-SER 


R1-SW3-P25 


R1-S25-NIC1 


R1-SW1-M3-P15 


R1-S25-NIC2 


R1-SW2-P25 


R1-S26-SER 


R1-SW3-P26 


R1-S26-NIC1 


R1-SW1-M4-P8 


R1-S26-NIC2 


R1-SW2-P26 


R1-S27-SER 


R1-SW3-P27 


R1-S27-NIC1 


R1-SW1-M4-P9 


R1-S27-NIC2 


R1-SW2-P27 


R1-S28-SER 


R1-SW3-P28 


R1-S28-NIC1 


R1-SW1-M4-P10 


R1-S28-NIC2 


R1-SW2-P28 


R1-S29-SER 


R1-SW3-P29 


R1-S29-NIC1 


R1-SW1-M4-P1 1 


R1-S29-NIC2 


R1-SW2-P29 


R1-S30-SER 


R1-SW3-P30 


R1-S30-NIC1 


R1-SW1-M4-P12 


R1-S30-NIC2 


R1-SW2-P30 


R1-S31-SER 


R1-SW3-P31 


R1-S31-NIC1 


R1-SW1-M4-P13 


R1-S31-NIC2 


R1-SW2-P31 


R1-S32-SER 


R1-SW3-P32 


R1-S32-NIC1 


R1-SW1-M4-P14 


R1-S32-NIC2 


R1-SW2-P32 


R1-S33-SER 


R1-SW3-P33 


R1-S33-NIC1 


R1-SW1-M4-P15 


R1-S33-NIC2 


R1-SW2-P33 


R2-S1-SER 


R2-SW2-P1 


R2-S1-NIC1 


R1-SW1-M5-P8 


R2-S1-NIC2 


R2-SW1-P1 


R2-S2-SER 


R2-SW2-P2 


R2-S2-NIC1 


R1-SW1-M5-P9 


R2-S2-NIC2 


R2-SW1-P2 


R2-S3-SER 


R2-SW2-P3 


R2-S3-NIC1 


R1-SW1-M5-P10 


R2-S3-NIC2 


R2-SW1-P3 


R2-S4-SER 


R2-SW2-P4 


R2-S4-NIC1 


R1-SW1-M5-P11 


R2-S4-NIC2 


R2-SW1-P4 


R2-S5-SER 


R2-SW2-P5 


R2-S5-NIC1 


R1-SW1-M5-P12 


R2-S5-NIC2 


R2-SW1-P5 


R2-S6-SER 


R2-SW2-P6 


R2-S6-NIC1 


R1-SW1-M5-P13 


R2-S6-NIC2 


R2-SW1-P6 


R2-S7-SER 


R2-SW2-P7 


R2-S7-NIC1 


R1-SW1-M5-P14 


R2-S7-NIC2 


R2-SW1-P7 


R2-S8-SER 


R2-SW2-P8 


R2-S8-NIC1 


R1-SW1-M5-P15 


R2-S8-NIC2 


R2-SW1-P8 


R2-S9-SER 


R2-SW2-P9 


R2-S9-NIC1 


R1-SW1-M6-P8 


R2-S9-NIC2 


R2-SW1-P9 


R2-S10-SER 


R2-SW2-P10 


R2-S10-NIC1 


R1-SW1-M6-P9 


R2-S10-NIC2 


R2-SW1-P10 
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Table 9-2: 32 Node GigE Cabling for DL140 LC Clusters Expandable to 64 Nodes continued 



00B Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 


Origin (server) 


Destination 

y O HV ■ LVil 1 1 


Origin (server) 


Destination 

1 W V¥ HVfllJ 


R2-S1 1-SER 


R2-SW2-P1 1 


R2-S1 1-NIC1 


R1-SW1-M6-P10 


R2-S1 1-NIC2 


R2-SW1-P1 1 


R2-S12-SER 


R2-SW2-P12 


R2-S12-NIC1 


R1-SW1-M6-P1 1 


R2-S12-NIC2 


R2-SW1-P12 


R2-S13-SER 


R2-SW2-P13 


R2-S13-NIC1 


R1-SW1-M6-P12 


R2-S13-NIC2 


R2-SW1-P13 


R2-S14-SER 


R2-SW2-P14 


R2-S14-NIC1 


R1-SW1-M6-P13 


R2-S14-NIC2 


R2-SW1-P14 


R2-S15-SER 


R2-SW2-P15 


R2-S15-NIC1 


R1-SW1-M6-P14 


R2-S15-NIC2 


R2-SW1-P15 


R2-S16-SER 


R2-SW2-P16 


R2-S16-NIC1 


R1-SW1-M6-P15 


R2-S16-NIC2 


R2-SW1-P16 


R2-S17-SER 


R2-SW2-P17 


R2-S17-NIC1 


R1-SW1-M7-P8 


R2-S17-NIC2 


R2-SW1-P17 


R2-S18-SER 


R2-SW2-P18 


R2-S18-NIC1 


R1-SW1-M7-P9 


R2-S18-NIC2 


R2-SW1-P18 


R2-S19-SER 


R2-SW2-P19 


R2-S19-NIC1 


R1-SW1-M7-P10 


R2-S19-NIC2 


R2-SW1-P19 


R2-S20-SER 


R2-SW2-P20 


R2-S20-NIC1 


R1-SW1-M7-P1 1 


R2-S20-NIC2 


R2-SW1-P20 


R2-S21-SER 


R2-SW2-P21 


R2-S21-NIC1 


R1-SW1-M7-P12 


R2-S21-NIC2 


R2-SW1-P21 


R2-S22-SER 


R2-SW2-P22 


R2-S22-NIC1 


R1-SW1-M7-P13 


R2-S22-NIC2 


R2-SW1-P22 


R2-S23-SER 


R2-SW2-P23 


R2-S23-NIC1 


R1-SW1-M7-P14 


R2-S23-NIC2 


R2-SW1-P23 


R2-S24-SER 


R2-SW2-P24 


R2-S24-NIC1 


R1-SW1-M7-P15 


R2-S24-NIC2 


R2-SW1-P24 


R2-S25-SER 


R2-SW2-P25 


R2-S25-NIC1 


R1-SW1-M8-P8 


R2-S25-NIC2 


R2-SW1-P25 


R2-S26-SER 


R2-SW2-P26 


R2-S26-NIC1 


R1-SW1-M8-P9 


R2-S26-NIC2 


R2-SW1-P26 


R2-S27-SER 


R2-SW2-P27 


R2-S27-NIC1 


R1-SW1-M8-P10 


R2-S27-NIC2 


R2-SW1-P27 


R2-S28-SER 


R2-SW2-P28 


R2-S28-NIC1 


R1-SW1-M8-P11 


R2-S28-NIC2 


R2-SW1-P28 


R2-S29-SER 


R2-SW2-P29 


R2-S29-NIC1 


R1-SW1-M8-P12 


R2-S29-NIC2 


R2-SW1-P29 


R2-S30-SER 


R2-SW2-P30 


R2-S30-NIC1 


R1-SW1-M8-P13 


R2-S30-NIC2 


R2-SW1-P30 


R2-S31-SER 


R2-SW2-P31 


R2-S31-NIC1 


R1-SW1-M8-P14 


R2-S31-NIC2 


R2-SW1-P31 


R2-S32-SER 


R2-SW2-P32 


R2-S32-NIC1 


R1-SW1-M8-P15 


R2-S32-NIC2 


R2-SW1-P32 



Table 9-3: Myricom Monitor 


From 


To 


R1-SW1-M9-P1 


R1-SW2-P47 



Table 9-4: 00B Management Switch Uplink 


From 


To 


R1-SW3-P48 


R1-SW2-P48 


R2-SW2-P48 


R2-SW1-P48 
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Table 9-5: IB Management Switch Uplink 


From 


To 




R1-SW2-P46 


R2-SW1-P47 


Trunked together 


R1-SW2-P45 


R2-SW1-P46 


R1-SW2-P44 


R2-SW1-P45 


R1-SW2-P43 


R2-SW1-P44 
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T 



DL140 
Compute 



NIC1 ■ 
NIC2 ■ 
Serial • 
Node ATA 2 

1 



• 




• 




• 




I 


DL140 


NIC1 - 


Compute 


NIC2 - 
Serial — 


Node 


ATA 2 — 




I 


DL140 


NIC1 - 


Compute 


NIC2 - 
Serial ~ 


Node 


ATA 2 - 
ATA 1 - 



I 


DL140 


NIC1 - 


Compute 


Serial — 


Node 


ATA 2 — 
ATA 1 - 



DL380 NIC2' 

Control Nici. 

K I -I Senal " 

Node scsi 2- 
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Rack Diagram 



Rack 1 (R1) 



Rack 2 (R2) 



42 


S33 


DL140 


41 


S32 


DL140 


40 


S31 


DL140 


39 


S30 


DL140 


38 


S29 


DL140 


37 


S28 


DL140 


36 


S27 


DL140 


35 


S26 


DL140 


34 


S25 


DL140 


33 


S24 


DL140 


32 


S23 


DL140 


31 


S22 


DL140 


30 


S21 DL380 


29 


28 


S20 


DL140 


27 


S19 


DL140 


26 


S18 


DL140 


25 


S17 


DL140 


24 


S16 


DL140 


23 


S15 


DL140 


22 


SW3 


Cyclades 


21 


SW2 


ProCurve 2650 


20 


TFT5600 


19 


S14 


DL140 


18 


S13 


DL140 


17 


S12 


DL140 


16 


S11 


DL140 


15 


S10 


DL140 


14 


S9 


DL140 


13 


S8 


DL140 


12 


S7 


DL140 


11 


S6 


DL140 


10 


S5 


DL140 


9 


S4 


DL140 


8 


S3 


DL140 


7 


S2 


DL140 


6 


S1 


DL140 


5 






4 






3 


SW1 


ProCurve 5372 


2 
1 







S40 


Expansion 


S39 


Expansion 


S38 


Expansion 


S37 


Expansion 


S36 


Expansion 


S35 


Expansion 


S34 


Expansion 


S33 


Expansion 


S32 


Expansion 


S31 


Expansion 


S30 


Expansion 


S29 


Expansion 


S28 


Expansion 


S27 


Expansion 


S26 


Expansion 


S25 


Expansion 


S24 


Expansion 


S23 


Expansion 


S22 


Expansion 


S21 


Expansion 


SW2 


Expansion 


SW1 


Expansion 


S20 


Expansion 


S19 


Expansion 


S18 


Expansion 


S17 


Expansion 


S16 


Expansion 


S15 


Expansion 


S14 


Expansion 


S13 


Expansion 


S12 


Expansion 


S11 


Expansion 


S10 


Expansion 


S9 


Expansion 


S8 


Expansion 


S7 


Expansion 


S6 


Expansion 


S5 


Expansion 


S4 


Expansion 


S3 


Expansion 


S2 


Expansion 


S1 


Expansion 
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Table 10-1: Cable Label Nomenclature 


Symbol 


Description 


R 


Rack number 


S 


Control/Compute/Storage node number 


SW 


Out of Band (OOB) Management Switch/Cluster Interconnect Switch/In Band (IB) 
Management Switch number 


M 


Module letter or Module number 


P 


Port number 


NIC 


NIC port number 


SER 


Serial port 



Table 10-2: 32 Node Fast Ethernet Cabling for DL140 LC Clusters Expandable to 72 Nodes 


OOB Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R1-S1-SER 


R1-SW3-P1 


R1-S1-NIC1 


R1-SW1-MB-P1 


R1-S1-NIC2 


R1-SW2-P1 


R1-S2-SER 


R1-SW3-P2 


R1-S2-NIC1 


R1-SW1-MB-P2 


R1-S2-NIC2 


R1-SW2-P2 


R1-S3-SER 


R1-SW3-P3 


R1-S3-NIC1 


R1-SW1-MB-P3 


R1-S3-NIC2 


R1-SW2-P3 


R1-S4-SER 


R1-SW3-P4 


R1-S4-NIC1 


R1-SW1-MB-P4 


R1-S4-NIC2 


R1-SW2-P4 


R1-S5-SER 


R1-SW3-P5 


R1-S5-NIC1 


R1-SW1-MB-P5 


R1-S5-NIC2 


R1-SW2-P5 


R1-S6-SER 


R1-SW3-P6 


R1-S6-NIC1 


R1-SW1-MB-P6 


R1-S6-NIC2 


R1-SW2-P6 


R1-S7-SER 


R1-SW3-P7 


R1-S7-NIC1 


R1-SW1-MB-P7 


R1-S7-NIC2 


R1-SW2-P7 


R1-S8-SER 


R1-SW3-P8 


R1-S8-NIC1 


R1-SW1-MB-P8 


R1-S8-NIC2 


R1-SW2-P8 


R1-S9-SER 


R1-SW3-P9 


R1-S9-NIC1 


R1-SW1-MB-P9 


R1-S9-NIC2 


R1-SW2-P9 


R1-S10-SER 


R1-SW3-P10 


R1-S10-NIC1 


R1-SW1-MB-P10 


R1-S10-NIC2 


R1-SW2-P10 


R1-S11-SER 


R1-SW3-P11 


R1-S1 1-NIC1 


R1-SW1-MB-P11 


R1-S11-NIC2 


R1-SW2-P11 


R1-S12-SER 


R1-SW3-P12 


R1-S12-NIC1 


R1-SW1-MB-P12 


R1-S12-NIC2 


R1-SW2-P12 


R1-S13-SER 


R1-SW3-P13 


R1-S13-NIC1 


R1-SW1-MB-P13 


R1-S13-NIC2 


R1-SW2-P13 
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Table 10-2: 32 Node Fast Ethernet Cabling for DL140 LC Clusters Expandable to 72 Nodes 

continued 



OOB Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R1-S14-SER 


R1-SW3-P14 


R1-S14-NIC1 


R1-SW1-MB-P14 


R1-S14-NIC2 


R1-SW2-P14 


R1-S15-SER 


R1-SW3-P15 


R1-S15-NIC1 


R1-SW1-MB-P15 


R1-S15-NIC2 


R1-SW2-P15 


R1-S16-SER 


R1-SW3-P16 


R1-S16-NIC1 


R1-SW1-MB-P16 


R1-S16-NIC2 


R1-SW2-P16 


R1-S17-SER 


R1-SW3-P17 


R1-S17-NIC1 


R1-SW1-MB-P17 


R1-S17-NIC2 


R1-SW2-P17 


R1-S18-SER 


R1-SW3-P18 


R1-S18-NIC1 


R1-SW1-MB-P18 


R1-S18-NIC2 


R1-SW2-P18 


R1-S19-SER 


R1-SW3-P19 


R1-S19-NIC1 


R1-SW1-MB-P19 


R1-S19-NIC2 


R1-SW2-P19 


R1-S20-SER 


R1-SW3-P20 


R1-S20-NIC1 


R1-SW1-MB-P20 


R1-S20-NIC2 


R1-SW2-P20 


R1-S21-SER 


R1-SW3-P21 


N/A 


N/A 


R1-S21-NIC2 


R1-SW2-P21 


R1-S22-SER 


R1-SW3-P22 


R1-S22-NIC1 


R1-SW1-MB-P21 


R1-S22-NIC2 


R1-SW2-P22 


R1-S23-SER 


R1-SW3-P23 


R1-S23-NIC1 


R1-SW1-MB-P22 


R1-S23-NIC2 


R1-SW2-P23 


R1-S24-SER 


R1-SW3-P24 


R1-S24-NIC1 


R1-SW1-MB-P23 


R1-S24-NIC2 


R1-SW2-P24 


R1-S25-SER 


R1-SW3-P25 


R1-S25-NIC1 


R1-SW1-MB-P24 


R1-S25-NIC2 


R1-SW2-P25 


R1-S26-SER 


R1-SW3-P26 


R1-S26-NIC1 


R1-SW1-MC-P1 


R1-S26-NIC2 


R1-SW2-P26 


R1-S27-SER 


R1-SW3-P27 


R1-S27-NIC1 


R1-SW1-MC-P2 


R1-S27-NIC2 


R1-SW2-P27 


R1-S28-SER 


R1-SW3-P28 


R1-S28-NIC1 


R1-SW1-MC-P3 


R1-S28-NIC2 


R1-SW2-P28 


R1-S29-SER 


R1-SW3-P29 


R1-S29-NIC1 


R1-SW1-MC-P4 


R1-S29-NIC2 


R1-SW2-P29 


R1-S30-SER 


R1-SW3-P30 


R1-S30-NIC1 


R1-SW1-MC-P5 


R1-S30-NIC2 


R1-SW2-P30 


R1-S31-SER 


R1-SW3-P31 


R1-S31-NIC1 


R1-SW1-MC-P6 


R1-S31-NIC2 


R1-SW2-P31 


R1-S32-SER 


R1-SW3-P32 


R1-S32-NIC1 


R1-SW1-MC-P7 


R1-S32-NIC2 


R1-SW2-P32 


R1-S33-SER 


R1-SW3-P33 


R1-S33-NIC1 


R1-SW1-MC-P8 


R1-S33-NIC2 


R1-SW2-P33 


R2-S1-SER 


R2-SW2-P1 


R2-S1-NIC1 


R1-SW1-MC-P9 


R2-S1-NIC2 


R2-SW1-P1 


R2-S2-SER 


R2-SW2-P2 


R2-S2-NIC1 


R1-SW1-MC-P10 


R2-S2-NIC2 


R2-SW1-P2 


R2-S3-SER 


R2-SW2-P3 


R2-S3-NIC1 


R1-SW1-MC-P11 


R2-S3-NIC2 


R2-SW1-P3 


R2-S4-SER 


R2-SW2-P4 


R2-S4-NIC1 


R1-SW1-MC-P12 


R2-S4-NIC2 


R2-SW1-P4 


R2-S5-SER 


R2-SW2-P5 


R2-S5-NIC1 


R1-SW1-MC-P13 


R2-S5-NIC2 


R2-SW1-P5 


R2-S6-SER 


R2-SW2-P6 


R2-S6-NIC1 


R1-SW1-MC-P14 


R2-S6-NIC2 


R2-SW1-P6 


R2-S7-SER 


R2-SW2-P7 


R2-S7-NIC1 


R1-SW1-MC-P15 


R2-S7-NIC2 


R2-SW1-P7 


R2-S8-SER 


R2-SW2-P8 


R2-S8-NIC1 


R1-SW1-MC-P16 


R2-S8-NIC2 


R2-SW1-P8 


R2-S9-SER 


R2-SW2-P9 


R2-S9-NIC1 


R1-SW1-MC-P17 


R2-S9-NIC2 


R2-SW1-P9 


R2-S10-SER 


R2-SW2-P10 


R2-S10-NIC1 


R1-SW1-MC-P18 


R2-S10-NIC2 


R2-SW1-P10 
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Table 10-2: 32 Node Fast Ethernet Cabling for DL140 LC Clusters Expandable to 72 Nodes 

continued 



OOB Switch Cabling 


Cluster Interconnect Switch 
Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R2-S11-SER 


R2-SW2-P1 1 


R2-S11-NIC1 


R1-SW1-MC-P19 


R2-S11-NIC2 


R2-SW1-P11 


R2-S12-SER 


R2-SW2-P12 


R2-S12-NIC1 


R1-SW1-MC-P20 


R2-S12-NIC2 


R2-SW1-P12 


R2-S13-SER 


R2-SW2-P13 


R2-S13-NIC1 


R1-SW1-MC-P21 


R2-S13-NIC2 


R2-SW1-P13 


R2-S14-SER 


R2-SW2-P14 


R2-S14-NIC1 


R1-SW1-MC-P22 


R2-S14-NIC2 


R2-SW1-P14 


R2-S15-SER 


R2-SW2-P15 


R2-S15-NIC1 


R1-SW1-MC-P23 


R2-S15-NIC2 


R2-SW1-P15 


R2-S16-SER 


R2-SW2-P16 


R2-S16-NIC1 


R1-SW1-MC-P24 


R2-S16-NIC2 


R2-SW1-P16 


R2-S17-SER 


R2-SW2-P17 


R2-S17-NIC1 


R1-SW1-MD-P1 


R2-S17-NIC2 


R2-SW1-P17 


R2-S18-SER 


R2-SW2-P18 


R2-S18-NIC1 


R1-SW1-MD-P2 


R2-S18-NIC2 


R2-SW1-P18 


R2-S19-SER 


R2-SW2-P19 


R2-S19-NIC1 


R1-SW1-MD-P3 


R2-S19-NIC2 


R2-SW1-P19 


R2-S20-SER 


R2-SW2-P20 


R2-S20-NIC1 


R1-SW1-MD-P4 


R2-S20-NIC2 


R2-SW1-P20 


R2-S21-SER 


R2-SW2-P21 


R2-S21-NIC1 


R1-SW1-MD-P5 


R2-S21-NIC2 


R2-SW1-P21 


R2-S22-SER 


R2-SW2-P22 


R2-S22-NIC1 


R1-SW1-MD-P6 


R2-S22-NIC2 


R2-SW1-P22 


R2-S23-SER 


R2-SW2-P23 


R2-S23-NIC1 


R1-SW1-MD-P7 


R2-S23-NIC2 


R2-SW1-P23 


R2-S24-SER 


R2-SW2-P24 


R2-S24-NIC1 


R1-SW1-MD-P8 


R2-S24-NIC2 


R2-SW1-P24 


R2-S25-SER 


R2-SW2-P25 


R2-S25-NIC1 


R1-SW1-MD-P9 


R2-S25-NIC2 


R2-SW1-P25 


R2-S26-SER 


R2-SW2-P26 


R2-S26-NIC1 


R1-SW1-MD-P10 


R2-S26-NIC2 


R2-SW1-P26 


R2-S27-SER 


R2-SW2-P27 


R2-S27-NIC1 


R1-SW1-MD-P11 


R2-S27-NIC2 


R2-SW1-P27 


R2-S28-SER 


R2-SW2-P28 


R2-S28-NIC1 


R1-SW1-MD-P12 


R2-S28-NIC2 


R2-SW1-P28 


R2-S29-SER 


R2-SW2-P29 


R2-S29-NIC1 


R1-SW1-MD-P13 


R2-S29-NIC2 


R2-SW1-P29 


R2-S30-SER 


R2-SW2-P30 


R2-S30-NIC1 


R1-SW1-MD-P14 


R2-S30-NIC2 


R2-SW1-P30 


R2-S31-SER 


R2-SW2-P31 


R2-S31-NIC1 


R1-SW1-MD-P15 


R2-S31-NIC2 


R2-SW1-P31 


R2-S32-SER 


R2-SW2-P32 


R2-S32-NIC1 


R1-SW1-MD-P16 


R2-S32-NIC2 


R2-SW1-P32 


R2-S33-SER 


R2-SW2-P33 


R2-S33-NIC1 


R1-SW1-MD-P17 


R2-S33-NIC2 


R2-SW1-P33 


R2-S34-SER 


R2-SW2-P34 


R2-S34-NIC1 


R1-SW1-MD-P18 


R2-S34-NIC2 


R2-SW1-P34 


R2-S35-SER 


R2-SW2-P35 


R2-S35-NIC1 


R1-SW1-MD-P19 


R2-S35-NIC2 


R2-SW1-P35 


R2-S36-SER 


R2-SW2-P36 


R2-S36-NIC1 


R1-SW1-MD-P20 


R2-S36-NIC2 


R2-SW1-P36 


R2-S37-SER 


R2-SW2-P37 


R2-S37-NIC1 


R1-SW1-MD-P21 


R2-S37-NIC2 


R2-SW1-P37 


R2-S38-SER 


R2-SW2-P38 


R2-S38-NIC1 


R1-SW1-MD-P22 


R2-S38-NIC2 


R2-SW1-P38 


R2-S39-SER 


R2-SW2-P39 


R2-S39-NIC1 


R1-SW1-MD-P23 


R2-S39-NIC2 


R2-SW1-P39 


R2-S40-SER 


R2-SW2-P40 


R2-S40-NIC1 


R1-SW1-MD-P24 


R2-S40-NIC2 


R2-SW1-P40 
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Table 10-3: OOB Management Switch Uplink 


From 


To 


R1-SW3-P48 


R1-SW2-P48 


R2-SW2-P48 


R2-SW1-P48 



Table 10-4: IB Management Switch Uplink 


From 


To 




R1-SW2-P50 


R2-SW1-P50 


Trunked together 


R1-SW2-P49 


R2-SW1-P49 
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DL140 NIC1 , 

Compute nic2- 

ii . Serial* 

Node ATA 2 ■ 



| My- ■ 

DL140 NIC1 . 
Compute nic2- 

r . Serial 
Node ATA 2' 

ATA 1 * 



I My, - 


DL140 


N1C1 - 


Compute 


NIC2- 


Node 


ATA2 - 




ATA 1 - 



| Myr - 


DL140 


NiC1 - 


Compute 




Node 


ATA 2 — 




ATA 1 - 
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64 Node Myrinet Expandable to 128 Nodes 



Rack Diagram 



Rack 1 (R1) 



Rack 2 (R2) 



42 


S40 


Expansion 


41 


S39 


Expansion 


40 


S38 


Expansion 


39 


S37 


Expansion 


38 


S36 


DL140 


37 


S35 


DL140 


36 


S34 


DL140 


35 


S33 


DL140 


34 


S32 


DL140 


33 


S31 


DL140 


32 


S30 


DL140 


31 


S29 


DL140 


30 


S28 


DL140 


29 


S27 


DL140 


28 


S26 


DL140 


27 


S25 


DL140 


26 


S24 


DL140 


25 


S23 


DL140 


24 


S22 


DL140 


23 


S21 


DL140 


22 


SW2 


Cyclades 


21 


SW1 


ProCurve 2848 


20 


S20 


DL140 


19 


S19 


DL140 


18 


S18 


DL140 


17 


S17 


DL140 


16 


S16 


DL140 


15 


S15 


DL140 


14 


S14 


DL140 


13 


S13 


DL140 


12 


S12 


DL140 


11 


S11 


DL140 


10 


S10 


DL140 


9 


S9 


DL140 


8 


S8 


DL140 


7 


S7 


DL140 


6 


S6 


DL140 


5 


S5 


DL140 


4 


S4 


DL140 


3 


S3 


DL140 


2 


S2 


DL140 


1 


S1 


DL140 



S29 


DL140 


S28 


DL140 


S27 


DL140 


S26 


DL140 


S25 


DL140 


S24 


DL140 


S23 


DL140 


S22 


DL140 


S21 


DL140 


S20 


DL140 


S19 


DL140 


S18 


DL140 


S17 


DL380 


S16 


DL140 


S15 


DL140 


S14 


DL140 


S13 


DL140 


S12 


DL140 


S11 


DL140 


SW3 


Cyclades 


SW2 


ProCurve 2848 


TFT5600 


S10 


DL140 


S9 


DL140 


S8 


DL140 


S7 


DL140 


S6 


DL140 


S5 


DL140 


S4 


DL140 


S3 


DL140 


S2 


DL140 


S1 


DL140 


SW1 


Myricom 
17 slot chassis 
w/Myrinet 
line cards 



Rack 3 (R3) 



S40 


Expansion 


S39 


Expansion 


S38 


Expansion 


S37 


Expansion 


S36 


Expansion 


S35 


Expansion 


S34 


Expansion 


S33 


Expansion 


S32 


Expansion 


S31 


Expansion 


S30 


Expansion 


S29 


Expansion 


S28 


Expansion 


S27 


Expansion 


S26 


Expansion 


S25 


Expansion 


S24 


Expansion 


S23 


Expansion 


S22 


Expansion 


S21 


Expansion 




Expansion 


SW1 


Expansion 


S20 


Expansion 


S19 


Expansion 


S18 


Expansion 


S17 


Expansion 


S16 


Expansion 


S15 


Expansion 


S14 


Expansion 


S13 


Expansion 


S12 


Expansion 


S11 


Expansion 


S10 


Expansion 


S9 


Expansion 


S8 


Expansion 


S7 


Expansion 


S6 


Expansion 


S5 


Expansion 


S4 


Expansion 


S3 


Expansion 


S2 


Expansion 


S1 


Expansion 



Rack 4 (R4) 



SW2 


Expansion 


SW1 


Expansion 


S20 


Expansion 


S19 


Expansion 


S18 


Expansion 


S17 


Expansion 


S16 


Expansion 


S15 


Expansion 


S14 


Expansion 


S13 


Expansion 


S12 


Expansion 


S11 


Expansion 


S10 


Expansion 


S9 


Expansion 


S8 


Expansion 


S7 


Expansion 


S6 


Expansion 


S5 


Expansion 


S4 


Expansion 


S3 


Expansion 


S2 


Expansion 


S1 


Expansion 
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Point-to-Point Cabling Guide 



Table 11-1: Cable Label Nomenclature 


Symbol 


Description 


R 


Rack number 


S 


Control/Compute/Storage node number 


SW 


Out of Band (OOB) Management Switch/Cluster Interconnect Switch/In Band (IB) 
Management Switch number 


M 


Module letter or Module number 


P 


Port number 


NIC 


NIC port number 


SER 


Serial port 


PCI 


Myrinet Adapter (in PCI slot) 



Table 11-2: 64 Node Myrinet Cabling for DL140 LC Clusters Expandable to 128 Nodes 


OOB Switch Cabling 


Cluster Interconnect Switch Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R1-S1-SER 


R1-SW2-P1 


R1-S1-PCI 


R2-SW1-M4-P12 


R1-S1-NIC2 


R1-SW1-P1 


R1-S2-SER 


R1-SW2-P2 


R1-S2-PCI 


R2-SW1-M4-P13 


R1-S2-NIC2 


R1-SW1-P2 


R1-S3-SER 


R1-SW2-P3 


R1-S3-PCI 


R2-SW1-M4-P14 


R1-S3-NIC2 


R1-SW1-P3 


R1-S4-SER 


R1-SW2-P4 


R1-S4-PCI 


R2-SW1-M4-P15 


R1-S4-NIC2 


R1-SW1-P4 


R1-S5-SER 


R1-SW2-P5 


R1-S5-PCI 


R2-SW1-M5-P8 


R1-S5-NIC2 


R1-SW1-P5 


R1-S6-SER 


R1-SW2-P6 


R1-S6-PCI 


R2-SW1-M5-P9 


R1-S6-NIC2 


R1-SW1-P6 


R1-S7-SER 


R1-SW2-P7 


R1-S7-PCI 


R2-SW1-M5-P10 


R1-S7-NIC2 


R1-SW1-P7 


R1-S8-SER 


R1-SW2-P8 


R1-S8-PCI 


R2-SW1-M5-P11 


R1-S8-NIC2 


R1-SW1-P8 


R1-S9-SER 


R1-SW2-P9 


R1-S9-PCI 


R2-SW1-M5-P12 


R1-S9-NIC2 


R1-SW1-P9 


R1-S10-SER 


R1-SW2-P10 


R1-S10-PCI 


R2-SW1-M5-P13 


R1-S10-NIC2 


R1-SW1-P10 


R1-S11-SER 


R1-SW2-P11 


R1-S11-PCI 


R2-SW1-M5-P14 


R1-S11-NIC2 


R1-SW1-P11 


R1-S12-SER 


R1-SW2-P12 


R1-S12-PCI 


R2-SW1-M5-P15 


R1-S12-NIC2 


R1-SW1-P12 


R1-S13-SER 


R1-SW2-P13 


R1-S13-PCI 


R2-SW1-M6-P8 


R1-S13-NIC2 


R1-SW1-P13 
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64 Node Myrinet Expandable to 128 Nodes 



Table 11-2: 64 Node Myrinet Cabling for DL140 LC Clusters Expandable to 128 Nodes continued 



00B Switch Cabling 


Cluster Interconnect Switch Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R1-S14-SER 


R1-SW2-P14 


R1-S14-PCI 


R2-SW1-M6-P9 


R1-S14-NIC2 


R1-SW1-P14 


R1-S15-SER 


R1-SW2-P15 


R1-S15-PCI 


R2-SW1-M6-P10 


R1-S15-NIC2 


R1-SW1-P15 


R1-S16-SER 


R1-SW2-P16 


R1-S16-PCI 


R2-SW1-M6-P11 


R1-S16-NIC2 


R1-SW1-P16 


R1-S17-SER 


R1-SW2-P17 


R1-S17-PCI 


R2-SW1-M6-P12 


R1-S17-NIC2 


R1-SW1-P17 


R1-S18-SER 


R1-SW2-P18 


R1-S18-PCI 


R2-SW1-M6-P13 


R1-S18-NIC2 


R1-SW1-P18 


R1-S19-SER 


R1-SW2-P19 


R1-S19-PCI 


R2-SW1-M6-P14 


R1-S19-NIC2 


R1-SW1-P19 


R1-S20-SER 


R1-SW2-P20 


R1-S20-PCI 


R2-SW1-M6-P15 


R1-S20-NIC2 


R1-SW1-P20 


R1-S21-SER 


R1-SW2-P21 


R1-S21-PCI 


R2-SW1-M7-P8 


R1-S21-NIC2 


R1-SW1-P21 


R1-S22-SER 


R1-SW2-P22 


R1-S22-PCI 


R2-SW1-M7-P9 


R1-S22-NIC2 


R1-SW1-P22 


R1-S23-SER 


R1-SW2-P23 


R1-S23-PCI 


R2-SW1-M7-P10 


R1-S23-NIC2 


R1-SW1-P23 


R1-S24-SER 


R1-SW2-P24 


R1-S24-PCI 


R2-SW1-M7-P11 


R1-S24-NIC2 


R1-SW1-P24 


R1-S25-SER 


R1-SW2-P25 


R1-S25-PCI 


R2-SW1-M7-P12 


R1-S25-NIC2 


R1-SW1-P25 


R1-S26-SER 


R1-SW2-P26 


R1-S26-PCI 


R2-SW1-M7-P13 


R1-S26-NIC2 


R1-SW1-P26 


R1-S27-SER 


R1-SW2-P27 


R1-S27-PCI 


R2-SW1-M7-P14 


R1-S27-NIC2 


R1-SW1-P27 


R1-S28-SER 


R1-SW2-P28 


R1-S28-PCI 


R2-SW1-M7-P15 


R1-S28-NIC2 


R1-SW1-P28 


R1-S29-SER 


R1-SW2-P29 


R1-S29-PCI 


R2-SW1-M8-P8 


R1-S29-NIC2 


R1-SW1-P29 


R1-S30-SER 


R1-SW2-P30 


R1-S30-PCI 


R2-SW1-M8-P9 


R1-S30-NIC2 


R1-SW1-P30 


R1-S31-SER 


R1-SW2-P31 


R1-S31-PCI 


R2-SW1-M8-P10 


R1-S31-NIC2 


R1-SW1-P31 


R1-S32-SER 


R1-SW2-P32 


R1-S32-PCI 


R2-SW1-M8-P11 


R1-S32-NIC2 


R1-SW1-P32 


R1-S33-SER 


R1-SW2-P33 


R1-S33-PCI 


R2-SW1-M8-P12 


R1-S33-NIC2 


R1-SW1-P33 


R1-S34-SER 


R1-SW2-P34 


R1-S34-PCI 


R2-SW1-M8-P13 


R1-S34-NIC2 


R1-SW1-P34 


R1-S35-SER 


R1-SW2-P35 


R1-S35-PCI 


R2-SW1-M8-P14 


R1-S35-NIC2 


R1-SW1-P35 


R1-S36-SER 


R1-SW2-P36 


R1-S36-PCI 


R2-SW1-M8-P15 


R1-S36-NIC2 


R1-SW1-P36 


R1-S37-SER 


R1-SW2-P37 


R1-S37-PCI 


R2-SW1-M9-P8 


R1-S37-NIC2 


R1-SW1-P37 


R1-S38-SER 


R1-SW2-P38 


R1-S38-PCI 


R2-SW1-M9-P9 


R1-S38-NIC2 


R1-SW1-P38 


R1-S39-SER 


R1-SW2-P39 


R1-S39-PCI 


R2-SW1-M9-P10 


R1-S39-NIC2 


R1-SW1-P39 


R1-S40-SER 


R1-SW2-P40 


R1-S40-PCI 


R2-SW1-M9-P11 


R1-S40-NIC2 


R1-SW1-P40 


R2-S1-SER 


R2-SW3-P1 


R2-S1-PCI 


R2-SW1-M1-P8 


R2-S1-NIC2 


R2-SW2-P1 


R2-S2-SER 


R2-SW3-P2 


R2-S2-PCI 


R2-SW1-M1-P9 


R2-S2-NIC2 


R2-SW2-P2 


R2-S3-SER 


R2-SW3-P3 


R2-S3-PCI 


R2-SW1-M1-P10 


R2-S3-NIC2 


R2-SW2-P3 
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Table 11-2: 64 Node Myrinet Cabling for DL140 LC Clusters Expandable to 128 Nodes continued 



00B Switch Cabling 


Cluster Interconnect Switch Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R2-S4-SER 


R2-SW3-P4 


R2-S4-PCI 


R2-SW1-M1-P11 


R2-S4-NIC2 


R2-SW2-P4 


R2-S5-SER 


R2-SW3-P5 


R2-S5-PCI 


R2-SW1-M1-P12 


R2-S5-NIC2 


R2-SW2-P5 


R2-S6-SER 


R2-SW3-P6 


R2-S6-PCI 


R2-SW1-M1-P13 


R2-S6-NIC2 


R2-SW2-P6 


R2-S7-SER 


R2-SW3-P7 


R2-S7-PCI 


R2-SW1-M1-P14 


R2-S7-NIC2 


R2-SW2-P7 


R2-S8-SER 


R2-SW3-P8 


R2-S8-PCI 


R2-SW1-M1-P15 


R2-S8-NIC2 


R2-SW2-P8 


R2-S9-SER 


R2-SW3-P9 


R2-S9-PCI 


R2-SW1-M2-P8 


R2-S9-NIC2 


R2-SW2-P9 


R2-S10-SER 


R2-SW3-P10 


R2-S10-PCI 


R2-SW1-M2-P9 


R2-S10-NIC2 


R2-SW2-P10 


R2-S11-SER 


R2-SW3-P1 1 


R2-S11-PCI 


R2-SW1-M2-P10 


R2-S11-NIC2 


R2-SW2-P1 1 


R2-S12-SER 


R2-SW3-P12 


R2-S12-PCI 


R2-SW1-M2-P11 


R2-S12-NIC2 


R2-SW2-P12 


R2-S13-SER 


R2-SW3-P13 


R2-S13-PCI 


R2-SW1-M2-P12 


R2-S13-NIC2 


R2-SW2-P13 


R2-S14-SER 


R2-SW3-P14 


R2-S14-PCI 


R2-SW1-M2-P13 


R2-S14-NIC2 


R2-SW2-P14 


R2-S15-SER 


R2-SW3-P15 


R2-S15-PCI 


R2-SW1-M2-P14 


R2-S15-NIC2 


R2-SW2-P15 


R2-S16-SER 


R2-SW3-P16 


R2-S16-PCI 


R2-SW1-M2-P15 


R2-S16-NIC2 


R2-SW2-P16 


R2-S17-SER 


R2-SW3-P17 


N/A 


N/A 


R2-S17-NIC2 


R2-SW2-P17 


R2-S18-SER 


R2-SW3-P18 


R2-S18-PCI 


R2-SW1-M3-P8 


R2-S18-NIC2 


R2-SW2-P18 


R2-S19-SER 


R2-SW3-P19 


R2-S19-PCI 


R2-SW1-M3-P9 


R2-S19-NIC2 


R2-SW2-P19 


R2-S20-SER 


R2-SW3-P20 


R2-S20-PCI 


R2-SW1-M3-P10 


R2-S20-NIC2 


R2-SW2-P20 


R2-S21-SER 


R2-SW3-P21 


R2-S21-PCI 


R2-SW1-M3-P11 


R2-S21-NIC2 


R2-SW2-P21 


R2-S22-SER 


R2-SW3-P22 


R2-S22-PCI 


R2-SW1-M3-P12 


R2-S22-NIC2 


R2-SW2-P22 


R2-S23-SER 


R2-SW3-P23 


R2-S23-PCI 


R2-SW1-M3-P13 


R2-S23-NIC2 


R2-SW2-P23 


R2-S24-SER 


R2-SW3-P24 


R2-S24-PCI 


R2-SW1-M3-P14 


R2-S24-NIC2 


R2-SW2-P24 


R2-S25-SER 


R2-SW3-P25 


R2-S25-PCI 


R2-SW1-M3-P15 


R2-S25-NIC2 


R2-SW2-P25 


R2-S26-SER 


R2-SW3-P26 


R2-S26-PCI 


R2-SW1-M4-P8 


R2-S26-NIC2 


R2-SW2-P26 


R2-S27-SER 


R2-SW3-P27 


R2-S27-PCI 


R2-SW1-M4-P9 


R2-S27-NIC2 


R2-SW2-P27 


R2-S28-SER 


R2-SW3-P28 


R2-S28-PCI 


R2-SW1-M4-P10 


R2-S28-NIC2 


R2-SW2-P28 


R2-S29-SER 


R2-SW3-P29 


R2-S29-PCI 


R2-SW1-M4-P11 


R2-S29-NIC2 


R2-SW2-P29 


R3-S1-SER 


R3-SW2-P1 


R3-S1-PCI 


R2-SW1-M9-P12 


R3-S1-NIC2 


R3-SW1-P1 


R3-S2-SER 


R3-SW2-P2 


R3-S2-PCI 


R2-SW1-M9-P13 


R3-S2-NIC2 


R3-SW1-P2 


R3-S3-SER 


R3-SW2-P3 


R3-S3-PCI 


R2-SW1-M9-P14 


R3-S3-NIC2 


R3-SW1-P3 


R3-S4-SER 


R3-SW2-P4 


R3-S4-PCI 


R2-SW1-M9-P15 


R3-S4-NIC2 


R3-SW1-P4 
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Table 11-2: 64 Node Myrinet Cabling for DL140 LC Clusters Expandable to 128 Nodes continued 



00B Switch Cabling 


Cluster Interconnect Switch Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R3-S5-SER 


R3-SW2-P5 


R3-S5-PCI 


R2-SW1-M10-P8 


R3-S5-NIC2 


R3-SW1-P5 


R3-S6-SER 


R3-SW2-P6 


R3-S6-PCI 


R2-SW1-M10-P9 


R3-S6-NIC2 


R3-SW1-P6 


R3-S7-SER 


R3-SW2-P7 


R3-S7-PCI 


R2-SW1-M10-P10 


R3-S7-NIC2 


R3-SW1-P7 


R3-S8-SER 


R3-SW2-P8 


R3-S8-PCI 


R2-SW1-M10-P11 


R3-S8-NIC2 


R3-SW1-P8 


R3-S9-SER 


R3-SW2-P9 


R3-S9-PCI 


R2-SW1-M10-P12 


R3-S9-NIC2 


R3-SW1-P9 


R3-S10-SER 


R3-SW2-P10 


R3-S10-PCI 


R2-SW1-M10-P13 


R3-S10-NIC2 


R3-SW1-P10 


R3-S11-SER 


R3-SW2-P1 1 


R3-S11-PCI 


R2-SW1-M10-P14 


R3-S11-NIC2 


R3-SW1-P11 


R3-S12-SER 


R3-SW2-P12 


R3-S12-PCI 


R2-SW1-M10-P15 


R3-S12-NIC2 


R3-SW1-P12 


R3-S13-SER 


R3-SW2-P13 


R3-S13-PCI 


R2-SW1-M11-P8 


R3-S13-NIC2 


R3-SW1-P13 


R3-S14-SER 


R3-SW2-P14 


R3-S14-PCI 


R2-SW1-M11-P9 


R3-S14-NIC2 


R3-SW1-P14 


R3-S15-SER 


R3-SW2-P15 


R3-S15-PCI 


R2-SW1-M11-P10 


R3-S15-NIC2 


R3-SW1-P15 


R3-S16-SER 


R3-SW2-P16 


R3-S16-PCI 


R2-SW1-M11-P11 


R3-S16-NIC2 


R3-SW1-P16 


R3-S17-SER 


R3-SW2-P17 


R3-S17-PCI 


R2-SW1-M11-P12 


R3-S17-NIC2 


R3-SW1-P17 


R3-S18-SER 


R3-SW2-P18 


R3-S18-PCI 


R2-SW1-M11-P13 


R3-S18-NIC2 


R3-SW1-P18 


R3-S19-SER 


R3-SW2-P19 


R3-S19-PCI 


R2-SW1-M11-P14 


R3-S19-NIC2 


R3-SW1-P19 


R3-S20-SER 


R3-SW2-P20 


R3-S20-PCI 


R2-SW1-M11-P15 


R3-S20-NIC2 


R3-SW1-P20 


R3-S21-SER 


R3-SW2-P21 


R3-S21-PCI 


R2-SW1-M12-P8 


R3-S21-NIC2 


R3-SW1-P21 


R3-S22-SER 


R3-SW2-P22 


R3-S22-PCI 


R2-SW1-M12-P9 


R3-S22-NIC2 


R3-SW1-P22 


R3-S23-SER 


R3-SW2-P23 


R3-S23-PCI 


R2-SW1-M12-P10 


R3-S23-NIC2 


R3-SW1-P23 


R3-S24-SER 


R3-SW2-P24 


R3-S24-PCI 


R2-SW1-M12-P11 


R3-S24-NIC2 


R3-SW1-P24 


R3-S25-SER 


R3-SW2-P25 


R3-S25-PCI 


R2-SW1-M12-P12 


R3-S25-NIC2 


R3-SW1-P25 


R3-S26-SER 


R3-SW2-P26 


R3-S26-PCI 


R2-SW1-M12-P13 


R3-S26-NIC2 


R3-SW1-P26 


R3-S27-SER 


R3-SW2-P27 


R3-S27-PCI 


R2-SW1-M12-P14 


R3-S27-NIC2 


R3-SW1-P27 


R3-S28-SER 


R3-SW2-P28 


R3-S28-PCI 


R2-SW1-M12-P15 


R3-S28-NIC2 


R3-SW1-P28 


R3-S29-SER 


R3-SW2-P29 


R3-S29-PCI 


R2-SW1-M13-P8 


R3-S29-NIC2 


R3-SW1-P29 


R3-S30-SER 


R3-SW2-P30 


R3-S30-PCI 


R2-SW1-M13-P9 


R3-S30-NIC2 


R3-SW1-P30 


R3-S31-SER 


R3-SW2-P31 


R3-S31-PCI 


R2-SW1-M13-P10 


R3-S31-NIC2 


R3-SW1-P31 


R3-S32-SER 


R3-SW2-P32 


R3-S32-PCI 


R2-SW1-M13-P11 


R3-S32-NIC2 


R3-SW1-P32 


R3-S33-SER 


R3-SW2-P33 


R3-S33-PCI 


R2-SW1-M13-P12 


R3-S33-NIC2 


R3-SW1-P33 


R3-S34-SER 


R3-SW2-P34 


R3-S34-PCI 


R2-SW1-M13-P13 


R3-S34-NIC2 


R3-SW1-P34 
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Table 11-2: 64 Node Myrinet Cabling for DL140 LC Clusters Expandable to 128 Nodes continued 



00B Switch Cabling 


Cluster Interconnect Switch Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R3-S35-SER 


R3-SW2-P35 


R3-S35-PCI 


R2-SW1-M13-P14 


R3-S35-NIC2 


R3-SW1-P35 


R3-S36-SER 


R3-SW2-P36 


R3-S36-PCI 


R2-SW1-M13-P15 


R3-S36-NIC2 


R3-SW1-P36 


R3-S37-SER 


R3-SW2-P37 


R3-S37-PCI 


R2-SW1-M14-P8 


R3-S37-NIC2 


R3-SW1-P37 


R3-S38-SER 


R3-SW2-P38 


R3-S38-PCI 


R2-SW1-M14-P9 


R3-S38-NIC2 


R3-SW1-P38 


R3-S39-SER 


R3-SW2-P39 


R3-S39-PCI 


R2-SW1-M14-P10 


R3-S39-NIC2 


R3-SW1-P39 


R3-S40-SER 


R3-SW2-P40 


R3-S40-PCI 


R2-SW1-M14-P11 


R3-S40-NIC2 


R3-SW1-P40 


R4-S1-SER 


R4-SW2-P1 


R4-S1-PCI 


R2-SW1-M14-P12 


R4-S1-NIC2 


R4-SW1-P1 


R4-S2-SER 


R4-SW2-P2 


R4-S2-PCI 


R2-SW1-M14-P13 


R4-S2-NIC2 


R4-SW1-P2 


R4-S3-SER 


R4-SW2-P3 


R4-S3-PCI 


R2-SW1-M14-P14 


R4-S3-NIC2 


R4-SW1-P3 


R4-S4-SER 


R4-SW2-P4 


R4-S4-PCI 


R2-SW1-M14-P15 


R4-S4-NIC2 


R4-SW1-P4 


R4-S5-SER 


R4-SW2-P5 


R4-S5-PCI 


R2-SW1-M15-P8 


R4-S5-NIC2 


R4-SW1-P5 


R4-S6-SER 


R4-SW2-P6 


R4-S6-PCI 


R2-SW1-M15-P9 


R4-S6-NIC2 


R4-SW1-P6 


R4-S7-SER 


R4-SW2-P7 


R4-S7-PCI 


R2-SW1-M15-P10 


R4-S7-NIC2 


R4-SW1-P7 


R4-S8-SER 


R4-SW2-P8 


R4-S8-PCI 


R2-SW1-M15-P11 


R4-S8-NIC2 


R4-SW1-P8 


R4-S9-SER 


R4-SW2-P9 


R4-S9-PCI 


R2-SW1-M15-P12 


R4-S9-NIC2 


R4-SW1-P9 


R4-S10-SER 


R4-SW2-P10 


R4-S10-PCI 


R2-SW1-M15-P13 


R4-S10-NIC2 


R4-SW1-P10 


R4-S11-SER 


R4-SW2-P1 1 


R4-S11-PCI 


R2-SW1-M15-P14 


R4-S11-NIC2 


R4-SW1-P11 


R4-S12-SER 


R4-SW2-P12 


R4-S12-PCI 


R2-SW1-M15-P15 


R4-S12-NIC2 


R4-SW1-P12 


R4-S13-SER 


R4-SW2-P13 


R4-S13-PCI 


R2-SW1-M16-P8 


R4-S13-NIC2 


R4-SW1-P13 


R4-S14-SER 


R4-SW2-P14 


R4-S14-PCI 


R2-SW1-M16-P9 


R4-S14-NIC2 


R4-SW1-P14 


R4-S15-SER 


R4-SW2-P15 


R4-S15-PCI 


R2-SW1-M16-P10 


R4-S15-NIC2 


R4-SW1-P15 


R4-S16-SER 


R4-SW2-P16 


R4-S16-PCI 


R2-SW1-M16-P11 


R4-S16-NIC2 


R4-SW1-P16 


R4-S17-SER 


R4-SW2-P17 


R4-S17-PCI 


R2-SW1-M16-P12 


R4-S17-NIC2 


R4-SW1-P17 


R4-S18-SER 


R4-SW2-P18 


R4-S18-PCI 


R2-SW1-M16-P13 


R4-S18-NIC2 


R4-SW1-P18 


R4-S19-SER 


R4-SW2-P19 


R4-S19-PCI 


R2-SW1-M16-P14 


R4-S19-NIC2 


R4-SW1-P19 


R4-S20-SER 


R4-SW2-P20 


R4-S20-PCI 


R2-SW1-M16-P15 


R4-S20-NIC2 


R4-SW1-P20 



Table 11-3: Myricom Monitor 


From 


To 


R2-SW1-M17-P1 


R2-SW2-P47 
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Table 11-4: OOB Management Switch Uplink 


From 


To 


R1-SW2-P48 


R1-SW1-P48 


R2-SW3-P48 


R2-SW2-P48 


R3-SW2-P48 


R3-SW1-P48 


R4-SW2-P48 


R4-SW1-P48 



Table 11-5: IB Management Switch Uplink 


From 


To 




R2-SW2-P46 


R1-SW1-P47 


Trunked together 


R2-SW2-P45 


R1-SW1-P46 


R2-SW2-P44 


R1-SW1-P45 


R2-SW2-P43 


R1-SW1-P44 


R2-SW2-P42 


R3-SW1-P47 


Trunked together 


R2-SW2-P41 


R3-SW1-P46 


R2-SW2-P40 


R3-SW1-P45 


R2-SW2-P39 


R3-SW1-P44 


R2-SW2-P38 


R4-SW1-P47 


Trunked together 


R2-SW2-P37 


R4-SW1-P46 


R2-SW2-P36 


R4-SW1-P45 


R2-SW2-P35 


R4-SW1-P44 
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DL140 


NIC1 - 


Compute 


NIC2 - 
Serial - 
ATA 2 - 
ATA 1 - 


Node 



I 


DL140 




Compute 


NIC2 - 
Serial - 
ATA 2 - 
ATA 1 - 


Node 





DL140 
Compute 
Node 


NIC1 - 
NIC2- 

Senal - 

ATA 1 - 


• 




• 




• 







DL140 


NIC1 - 


Compute 


NIC2- 

Serial - 


Node 


ATA 2 — 




ATA 1 - 






DL140 


NIC1 - 


Compute 


NIC2 - 
Serial - 


Node 


ATA 2 - 




ATA 1 - 



I 


DL140 


NIC1 - 


Compute 


NIC2 - 
Serial - 


Node 


ATA 2 - 




ATA 1 - 




I 


DL140 




Compute 


NIC2 - 
Serial - 


Node 


ATA 2 - 




ATA 1 - 




I 


DL140 


NIC1 - 


Compute 


Serial - 
ATA 2 - 
ATA 1 - 


Node 



Public LAN 
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Rack Diagram 



Rack 1 (R1) 



42 


S40 


Expansion 


41 


S39 


Expansion 


40 


S38 


Expansion 


39 


S37 


Expansion 


38 


S36 


DL140 


37 


S35 


DL140 


36 


S34 


DL140 


35 


S33 


DL140 


34 


S32 


DL140 


33 


S31 


DL140 


32 


S30 


DL140 


31 


S29 


DL140 


30 


S28 


DL140 


29 


S27 


DL140 


28 


S26 


DL140 


27 


S25 


DL140 


26 


S24 


DL140 


25 


S23 


DL140 


24 


S22 


DL140 


23 


S21 


DL140 


22 




21 


SW1 


ProCurve 2848 


20 


S20 


DL140 


19 


S19 


DL140 


18 


S18 


DL140 


17 


S17 


DL140 


16 


S16 


DL140 


15 


S15 


DL140 


14 


S14 


DL140 


13 


S13 


DL140 


12 


S12 


DL140 


11 


S11 


DL140 


10 


S10 


DL140 


9 


S9 


DL140 


8 


S8 


DL140 


7 


S7 


DL140 


6 


S6 


DL140 


5 


S5 


DL140 


4 


S4 


DL140 


3 


S3 


DL140 


2 


S2 DL140 


1 







Rack 2 (R2) 



S29 


DL140 


S28 


DL140 


S27 


DL140 


S26 


DL140 


S25 


DL140 


S24 


DL140 


S23 


DL140 


S22 


DL140 


S21 


DL140 


S20 


DL140 


S19 


DL140 


S18 


DL140 


S17 


DL380 


S16 


DL140 


S15 


DL140 


S14 


DL140 


S13 


DL140 


S12 


DL140 


S11 


DL140 






SW2 


ProCurve 2848 


TFT5600 


S10 


DL140 


S9 


DL140 


S8 


DL140 


S7 


DL140 


S6 


DL140 


S5 


DL140 


S4 


DL140 


S3 


DL140 


S2 


DL140 


S1 


DL140 



Rack 3 (R3) 



SW1 



Myricom 
17 slot chassis 
w/GigE 
line cards 



S40 


Expansion 


S39 


Expansion 


S38 


Expansion 


S37 


Expansion 


S36 


Expansion 


S35 


Expansion 


S34 


Expansion 


S33 


Expansion 


S32 


Expansion 


S31 


Expansion 


S30 


Expansion 


S29 


Expansion 


S28 


Expansion 


S27 


Expansion 


S26 


Expansion 


S25 


Expansion 


S24 


Expansion 


S23 


Expansion 


S22 


Expansion 


S21 


Expansion 


SW1 


Expansion 


S20 


Expansion 


S19 


Expansion 


S18 


Expansion 


S17 


Expansion 


S16 


Expansion 


S15 


Expansion 


S14 


Expansion 


S13 


Expansion 


S12 


Expansion 


S11 


Expansion 


S10 


Expansion 


S9 


Expansion 


S8 


Expansion 


S7 


Expansion 


S6 


Expansion 


S5 


Expansion 


S4 


Expansion 


S3 


Expansion 


S2 


Expansion 


S1 


Expansion 



Rack 4 (R4) 



SW1 


Expansion 


S20 


Expansion 


S19 


Expansion 


S18 


Expansion 


S17 


Expansion 


S16 


Expansion 


S15 


Expansion 


S14 


Expansion 


S13 


Expansion 


S12 


Expansion 


S11 


Expansion 


S10 


Expansion 


S9 


Expansion 


S8 


Expansion 


S7 


Expansion 


S6 


Expansion 


S5 


Expansion 


S4 


Expansion 


S3 


Expansion 


S2 


Expansion 


S1 


Expansion 
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Table 12-1: Cable Label Nomenclature 


Symbol 


Description 


R 


Rack number 


S 


Control/Compute/Storage node number 


SW 


Out of Band (OOB) Management Switch/Cluster Interconnect Switch/In Band (IB) 
Management Switch number 


M 


Module letter or Module number 


P 


Port number 


NIC 


NIC port number 


SER 


Serial port 



Table 12-2: 64 Node GigE Cabling for DL140 LC Clusters Expandable to 128 Nodes 


OOB Switch Cabling 


Cluster Interconnect Switch Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R1-S1-SER 


R1-SW2-P1 


R1-S1-NIC1 


R2-SW1-M4-P12 


R1-S1-NIC2 


R1-SW1-P1 


R1-S2-SER 


R1-SW2-P2 


R1-S2-NIC1 


R2-SW1-M4-P13 


R1-S2-NIC2 


R1-SW1-P2 


R1-S3-SER 


R1-SW2-P3 


R1-S3-NIC1 


R2-SW1-M4-P14 


R1-S3-NIC2 


R1-SW1-P3 


R1-S4-SER 


R1-SW2-P4 


R1-S4-NIC1 


R2-SW1-M4-P15 


R1-S4-NIC2 


R1-SW1-P4 


R1-S5-SER 


R1-SW2-P5 


R1-S5-NIC1 


R2-SW1-M5-P8 


R1-S5-NIC2 


R1-SW1-P5 


R1-S6-SER 


R1-SW2-P6 


R1-S6-NIC1 


R2-SW1-M5-P9 


R1-S6-NIC2 


R1-SW1-P6 


R1-S7-SER 


R1-SW2-P7 


R1-S7-NIC1 


R2-SW1-M5-P10 


R1-S7-NIC2 


R1-SW1-P7 


R1-S8-SER 


R1-SW2-P8 


R1-S8-NIC1 


R2-SW1-M5-P11 


R1-S8-NIC2 


R1-SW1-P8 


R1-S9-SER 


R1-SW2-P9 


R1-S9-NIC1 


R2-SW1-M5-P12 


R1-S9-NIC2 


R1-SW1-P9 


R1-S10-SER 


R1-SW2-P10 


R1-S10-NIC1 


R2-SW1-M5-P13 


R1-S10-NIC2 


R1-SW1-P10 


R1-S11-SER 


R1-SW2-P11 


R1-S11-NIC1 


R2-SW1-M5-P14 


R1-S11-NIC2 


R1-SW1-P11 


R1-S12-SER 


R1-SW2-P12 


R1-S12-NIC1 


R2-SW1-M5-P15 


R1-S12-NIC2 


R1-SW1-P12 


R1-S13-SER 


R1-SW2-P13 


R1-S13-NIC1 


R2-SW1-M6-P8 


R1-S13-NIC2 


R1-SW1-P13 
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Table 12-2: 64 Node GigE Cabling for DL140 LC Clusters Expandable to 128 Nodes continued 



00B Switch Cabling 


Cluster Interconnect Switch Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R1-S14-SER 


R1-SW2-P14 


R1-S14-NIC1 


R2-SW1-M6-P9 


R1-S14-NIC2 


R1-SW1-P14 


R1-S15-SER 


R1-SW2-P15 


R1-S15-NIC1 


R2-SW1-M6-P10 


R1-S15-NIC2 


R1-SW1-P15 


R1-S16-SER 


R1-SW2-P16 


R1-S16-NIC1 


R2-SW1-M6-P11 


R1-S16-NIC2 


R1-SW1-P16 


R1-S17-SER 


R1-SW2-P17 


R1-S17-NIC1 


R2-SW1-M6-P12 


R1-S17-NIC2 


R1-SW1-P17 


R1-S18-SER 


R1-SW2-P18 


R1-S18-NIC1 


R2-SW1-M6-P13 


R1-S18-NIC2 


R1-SW1-P18 


R1-S19-SER 


R1-SW2-P19 


R1-S19-NIC1 


R2-SW1-M6-P14 


R1-S19-NIC2 


R1-SW1-P19 


R1-S20-SER 


R1-SW2-P20 


R1-S20-NIC1 


R2-SW1-M6-P15 


R1-S20-NIC2 


R1-SW1-P20 


R1-S21-SER 


R1-SW2-P21 


R1-S21-NIC1 


R2-SW1-M7-P8 


R1-S21-NIC2 


R1-SW1-P21 


R1-S22-SER 


R1-SW2-P22 


R1-S22-NIC1 


R2-SW1-M7-P9 


R1-S22-NIC2 


R1-SW1-P22 


R1-S23-SER 


R1-SW2-P23 


R1-S23-NIC1 


R2-SW1-M7-P10 


R1-S23-NIC2 


R1-SW1-P23 


R1-S24-SER 


R1-SW2-P24 


R1-S24-NIC1 


R2-SW1-M7-P11 


R1-S24-NIC2 


R1-SW1-P24 


R1-S25-SER 


R1-SW2-P25 


R1-S25-NIC1 


R2-SW1-M7-P12 


R1-S25-NIC2 


R1-SW1-P25 


R1-S26-SER 


R1-SW2-P26 


R1-S26-NIC1 


R2-SW1-M7-P13 


R1-S26-NIC2 


R1-SW1-P26 


R1-S27-SER 


R1-SW2-P27 


R1-S27-NIC1 


R2-SW1-M7-P14 


R1-S27-NIC2 


R1-SW1-P27 


R1-S28-SER 


R1-SW2-P28 


R1-S28-NIC1 


R2-SW1-M7-P15 


R1-S28-NIC2 


R1-SW1-P28 


R1-S29-SER 


R1-SW2-P29 


R1-S29-NIC1 


R2-SW1-M8-P8 


R1-S29-NIC2 


R1-SW1-P29 


R1-S30-SER 


R1-SW2-P30 


R1-S30-NIC1 


R2-SW1-M8-P9 


R1-S30-NIC2 


R1-SW1-P30 


R1-S31-SER 


R1-SW2-P31 


R1-S31-NIC1 


R2-SW1-M8-P10 


R1-S31-NIC2 


R1-SW1-P31 


R1-S32-SER 


R1-SW2-P32 


R1-S32-NIC1 


R2-SW1-M8-P11 


R1-S32-NIC2 


R1-SW1-P32 


R1-S33-SER 


R1-SW2-P33 


R1-S33-NIC1 


R2-SW1-M8-P12 


R1-S33-NIC2 


R1-SW1-P33 


R1-S34-SER 


R1-SW2-P34 


R1-S34-NIC1 


R2-SW1-M8-P13 


R1-S34-NIC2 


R1-SW1-P34 


R1-S35-SER 


R1-SW2-P35 


R1-S35-NIC1 


R2-SW1-M8-P14 


R1-S35-NIC2 


R1-SW1-P35 


R1-S36-SER 


R1-SW2-P36 


R1-S36-NIC1 


R2-SW1-M8-P15 


R1-S36-NIC2 


R1-SW1-P36 


R1-S37-SER 


R1-SW2-P37 


R1-S37-NIC1 


R2-SW1-M9-P8 


R1-S37-NIC2 


R1-SW1-P37 


R1-S38-SER 


R1-SW2-P38 


R1-S38-NIC1 


R2-SW1-M9-P9 


R1-S38-NIC2 


R1-SW1-P38 


R1-S39-SER 


R1-SW2-P39 


R1-S39-NIC1 


R2-SW1-M9-P10 


R1-S39-NIC2 


R1-SW1-P39 


R1-S40-SER 


R1-SW2-P40 


R1-S40-NIC1 


R2-SW1-M9-P11 


R1-S40-NIC2 


R1-SW1-P40 


R2-S1-SER 


R2-SW3-P1 


R2-S1-NIC1 


R2-SW1-M1-P8 


R2-S1-NIC2 


R2-SW2-P1 


R2-S2-SER 


R2-SW3-P2 


R2-S2-NIC1 


R2-SW1-M1-P9 


R2-S2-NIC2 


R2-SW2-P2 


R2-S3-SER 


R2-SW3-P3 


R2-S3-NIC1 


R2-SW1-M1-P10 


R2-S3-NIC2 


R2-SW2-P3 
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Table 12-2: 64 Node GigE Cabling for DL140 LC Clusters Expandable to 128 Nodes continued 



00B Switch Cabling 


Cluster Interconnect Switch Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R2-S4-SER 


R2-SW3-P4 


R2-S4-NIC1 


R2-SW1-M1-P11 


R2-S4-NIC2 


R2-SW2-P4 


R2-S5-SER 


R2-SW3-P5 


R2-S5-NIC1 


R2-SW1-M1-P12 


R2-S5-NIC2 


R2-SW2-P5 


R2-S6-SER 


R2-SW3-P6 


R2-S6-NIC1 


R2-SW1-M1-P13 


R2-S6-NIC2 


R2-SW2-P6 


R2-S7-SER 


R2-SW3-P7 


R2-S7-NIC1 


R2-SW1-M1-P14 


R2-S7-NIC2 


R2-SW2-P7 


R2-S8-SER 


R2-SW3-P8 


R2-S8-NIC1 


R2-SW1-M1-P15 


R2-S8-NIC2 


R2-SW2-P8 


R2-S9-SER 


R2-SW3-P9 


R2-S9-NIC1 


R2-SW1-M2-P8 


R2-S9-NIC2 


R2-SW2-P9 


R2-S10-SER 


R2-SW3-P10 


R2-S10-NIC1 


R2-SW1-M2-P9 


R2-S10-NIC2 


R2-SW2-P10 


R2-S11-SER 


R2-SW3-P1 1 


R2-S11-NIC1 


R2-SW1-M2-P10 


R2-S11-NIC2 


R2-SW2-P1 1 


R2-S12-SER 


R2-SW3-P12 


R2-S12-NIC1 


R2-SW1-M2-P11 


R2-S12-NIC2 


R2-SW2-P12 


R2-S13-SER 


R2-SW3-P13 


R2-S13-NIC1 


R2-SW1-M2-P12 


R2-S13-NIC2 


R2-SW2-P13 


R2-S14-SER 


R2-SW3-P14 


R2-S14-NIC1 


R2-SW1-M2-P13 


R2-S14-NIC2 


R2-SW2-P14 


R2-S15-SER 


R2-SW3-P15 


R2-S15-NIC1 


R2-SW1-M2-P14 


R2-S15-NIC2 


R2-SW2-P15 


R2-S16-SER 


R2-SW3-P16 


R2-S16-NIC1 


R2-SW1-M2-P15 


R2-S16-NIC2 


R2-SW2-P16 


R2-S17-SER 


R2-SW3-P17 


N/A 


N/A 


R2-S17-NIC2 


R2-SW2-P17 


R2-S18-SER 


R2-SW3-P18 


R2-S18-NIC1 


R2-SW1-M3-P8 


R2-S18-NIC2 


R2-SW2-P18 


R2-S19-SER 


R2-SW3-P19 


R2-S19-NIC1 


R2-SW1-M3-P9 


R2-S19-NIC2 


R2-SW2-P19 


R2-S20-SER 


R2-SW3-P20 


R2-S20-NIC1 


R2-SW1-M3-P10 


R2-S20-NIC2 


R2-SW2-P20 


R2-S21-SER 


R2-SW3-P21 


R2-S21-NIC1 


R2-SW1-M3-P11 


R2-S21-NIC2 


R2-SW2-P21 


R2-S22-SER 


R2-SW3-P22 


R2-S22-NIC1 


R2-SW1-M3-P12 


R2-S22-NIC2 


R2-SW2-P22 


R2-S23-SER 


R2-SW3-P23 


R2-S23-NIC1 


R2-SW1-M3-P13 


R2-S23-NIC2 


R2-SW2-P23 


R2-S24-SER 


R2-SW3-P24 


R2-S24-NIC1 


R2-SW1-M3-P14 


R2-S24-NIC2 


R2-SW2-P24 


R2-S25-SER 


R2-SW3-P25 


R2-S25-NIC1 


R2-SW1-M3-P15 


R2-S25-NIC2 


R2-SW2-P25 


R2-S26-SER 


R2-SW3-P26 


R2-S26-NIC1 


R2-SW1-M4-P8 


R2-S26-NIC2 


R2-SW2-P26 


R2-S27-SER 


R2-SW3-P27 


R2-S27-NIC1 


R2-SW1-M4-P9 


R2-S27-NIC2 


R2-SW2-P27 


R2-S28-SER 


R2-SW3-P28 


R2-S28-NIC1 


R2-SW1-M4-P10 


R2-S28-NIC2 


R2-SW2-P28 


R2-S29-SER 


R2-SW3-P29 


R2-S29-NIC1 


R2-SW1-M4-P11 


R2-S29-NIC2 


R2-SW2-P29 


R3-S1-SER 


R3-SW2-P1 


R3-S1-NIC1 


R2-SW1-M9-P12 


R3-S1-NIC2 


R3-SW1-P1 


R3-S2-SER 


R3-SW2-P2 


R3-S2-NIC1 


R2-SW1-M9-P13 


R3-S2-NIC2 


R3-SW1-P2 


R3-S3-SER 


R3-SW2-P3 


R3-S3-NIC1 


R2-SW1-M9-P14 


R3-S3-NIC2 


R3-SW1-P3 


R3-S4-SER 


R3-SW2-P4 


R3-S4-NIC1 


R2-SW1-M9-P15 


R3-S4-NIC2 


R3-SW1-P4 
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Table 12-2: 64 Node GigE Cabling for DL140 LC Clusters Expandable to 128 Nodes continued 



00B Switch Cabling 


Cluster Interconnect Switch Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R3-S5-SER 


R3-SW2-P5 


R3-S5-NIC1 


R2-SW1-M10-P8 


R3-S5-NIC2 


R3-SW1-P5 


R3-S6-SER 


R3-SW2-P6 


R3-S6-NIC1 


R2-SW1-M10-P9 


R3-S6-NIC2 


R3-SW1-P6 


R3-S7-SER 


R3-SW2-P7 


R3-S7-NIC1 


R2-SW1-M10-P10 


R3-S7-NIC2 


R3-SW1-P7 


R3-S8-SER 


R3-SW2-P8 


R3-S8-NIC1 


R2-SW1-M10-P11 


R3-S8-NIC2 


R3-SW1-P8 


R3-S9-SER 


R3-SW2-P9 


R3-S9-NIC1 


R2-SW1-M10-P12 


R3-S9-NIC2 


R3-SW1-P9 


R3-S10-SER 


R3-SW2-P10 


R3-S10-NIC1 


R2-SW1-M10-P13 


R3-S10-NIC2 


R3-SW1-P10 


R3-S11-SER 


R3-SW2-P1 1 


R3-S11-NIC1 


R2-SW1-M10-P14 


R3-S11-NIC2 


R3-SW1-P11 


R3-S12-SER 


R3-SW2-P12 


R3-S12-NIC1 


R2-SW1-M10-P15 


R3-S12-NIC2 


R3-SW1-P12 


R3-S13-SER 


R3-SW2-P13 


R3-S13-NIC1 


R2-SW1-M11-P8 


R3-S13-NIC2 


R3-SW1-P13 


R3-S14-SER 


R3-SW2-P14 


R3-S14-NIC1 


R2-SW1-M11-P9 


R3-S14-NIC2 


R3-SW1-P14 


R3-S15-SER 


R3-SW2-P15 


R3-S15-NIC1 


R2-SW1-M11-P10 


R3-S15-NIC2 


R3-SW1-P15 


R3-S16-SER 


R3-SW2-P16 


R3-S16-NIC1 


R2-SW1-M11-P11 


R3-S16-NIC2 


R3-SW1-P16 


R3-S17-SER 


R3-SW2-P17 


R3-S17-NIC1 


R2-SW1-M11-P12 


R3-S17-NIC2 


R3-SW1-P17 


R3-S18-SER 


R3-SW2-P18 


R3-S18-NIC1 


R2-SW1-M11-P13 


R3-S18-NIC2 


R3-SW1-P18 


R3-S19-SER 


R3-SW2-P1 9 


R3-S19-NIC1 


R2-SW1-M11-P14 


R3-S19-NIC2 


R3-SW1-P19 


R3-S20-SER 


R3-SW2-P20 


R3-S20-NIC1 


R2-SW1-M11-P15 


R3-S20-NIC2 


R3-SW1-P20 


R3-S21-SER 


R3-SW2-P21 


R3-S21-NIC1 


R2-SW1-M12-P8 


R3-S21-NIC2 


R3-SW1-P21 


R3-S22-SER 


R3-SW2-P22 


R3-S22-NIC1 


R2-SW1-M12-P9 


R3-S22-NIC2 


R3-SW1-P22 


R3-S23-SER 


R3-SW2-P23 


R3-S23-NIC1 


R2-SW1-M12-P10 


R3-S23-NIC2 


R3-SW1-P23 


R3-S24-SER 


R3-SW2-P24 


R3-S24-NIC1 


R2-SW1-M12-P11 


R3-S24-NIC2 


R3-SW1-P24 


R3-S25-SER 


R3-SW2-P25 


R3-S25-NIC1 


R2-SW1-M12-P12 


R3-S25-NIC2 


R3-SW1-P25 


R3-S26-SER 


R3-SW2-P26 


R3-S26-NIC1 


R2-SW1-M12-P13 


R3-S26-NIC2 


R3-SW1-P26 


R3-S27-SER 


R3-SW2-P27 


R3-S27-NIC1 


R2-SW1-M12-P14 


R3-S27-NIC2 


R3-SW1-P27 


R3-S28-SER 


R3-SW2-P28 


R3-S28-NIC1 


R2-SW1-M12-P15 


R3-S28-NIC2 


R3-SW1-P28 


R3-S29-SER 


R3-SW2-P29 


R3-S29-NIC1 


R2-SW1-M13-P8 


R3-S29-NIC2 


R3-SW1-P29 


R3-S30-SER 


R3-SW2-P30 


R3-S30-NIC1 


R2-SW1-M13-P9 


R3-S30-NIC2 


R3-SW1-P30 


R3-S31-SER 


R3-SW2-P31 


R3-S31-NIC1 


R2-SW1-M13-P10 


R3-S31-NIC2 


R3-SW1-P31 


R3-S32-SER 


R3-SW2-P32 


R3-S32-NIC1 


R2-SW1-M13-P11 


R3-S32-NIC2 


R3-SW1-P32 


R3-S33-SER 


R3-SW2-P33 


R3-S33-NIC1 


R2-SW1-M13-P12 


R3-S33-NIC2 


R3-SW1-P33 


R3-S34-SER 


R3-SW2-P34 


R3-S34-NIC1 


R2-SW1-M13-P13 


R3-S34-NIC2 


R3-SW1-P34 
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Table 12-2: 64 Node GigE Cabling for DL140 LC Clusters Expandable to 128 Nodes continued 



00B Switch Cabling 


Cluster Interconnect Switch Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R3-S35-SER 


R3-SW2-P35 


R3-S35-NIC1 


R2-SW1-M13-P14 


R3-S35-NIC2 


R3-SW1-P35 


R3-S36-SER 


R3-SW2-P36 


R3-S36-NIC1 


R2-SW1-M13-P15 


R3-S36-NIC2 


R3-SW1-P36 


R3-S37-SER 


R3-SW2-P37 


R3-S37-NIC1 


R2-SW1-M14-P8 


R3-S37-NIC2 


R3-SW1-P37 


R3-S38-SER 


R3-SW2-P38 


R3-S38-NIC1 


R2-SW1-M14-P9 


R3-S38-NIC2 


R3-SW1-P38 


R3-S39-SER 


R3-SW2-P39 


R3-S39-NIC1 


R2-SW1-M14-P10 


R3-S39-NIC2 


R3-SW1-P39 


R3-S40-SER 


R3-SW2-P40 


R3-S40-NIC1 


R2-SW1-M14-P11 


R3-S40-NIC2 


R3-SW1-P40 


R4-S1-SER 


R4-SW2-P1 


R4-S1-NIC1 


R2-SW1-M14-P12 


R4-S1-NIC2 


R4-SW1-P1 


R4-S2-SER 


R4-SW2-P2 


R4-S2-NIC1 


R2-SW1-M14-P13 


R4-S2-NIC2 


R4-SW1-P2 


R4-S3-SER 


R4-SW2-P3 


R4-S3-NIC1 


R2-SW1-M14-P14 


R4-S3-NIC2 


R4-SW1-P3 


R4-S4-SER 


R4-SW2-P4 


R4-S4-NIC1 


R2-SW1-M14-P15 


R4-S4-NIC2 


R4-SW1-P4 


R4-S5-SER 


R4-SW2-P5 


R4-S5-NIC1 


R2-SW1-M15-P8 


R4-S5-NIC2 


R4-SW1-P5 


R4-S6-SER 


R4-SW2-P6 


R4-S6-NIC1 


R2-SW1-M15-P9 


R4-S6-NIC2 


R4-SW1-P6 


R4-S7-SER 


R4-SW2-P7 


R4-S7-NIC1 


R2-SW1-M15-P10 


R4-S7-NIC2 


R4-SW1-P7 


R4-S8-SER 


R4-SW2-P8 


R4-S8-NIC1 


R2-SW1-M15-P11 


R4-S8-NIC2 


R4-SW1-P8 


R4-S9-SER 


R4-SW2-P9 


R4-S9-NIC1 


R2-SW1-M15-P12 


R4-S9-NIC2 


R4-SW1-P9 


R4-S10-SER 


R4-SW2-P10 


R4-S10-NIC1 


R2-SW1-M15-P13 


R4-S10-NIC2 


R4-SW1-P10 


R4-S11-SER 


R4-SW2-P1 1 


R4-S11-NIC1 


R2-SW1-M15-P14 


R4-S11-NIC2 


R4-SW1-P11 


R4-S12-SER 


R4-SW2-P12 


R4-S12-NIC1 


R2-SW1-M15-P15 


R4-S12-NIC2 


R4-SW1-P12 


R4-S13-SER 


R4-SW2-P13 


R4-S13-NIC1 


R2-SW1-M16-P8 


R4-S13-NIC2 


R4-SW1-P13 


R4-S14-SER 


R4-SW2-P14 


R4-S14-NIC1 


R2-SW1-M16-P9 


R4-S14-NIC2 


R4-SW1-P14 


R4-S15-SER 


R4-SW2-P15 


R4-S15-NIC1 


R2-SW1-M16-P10 


R4-S15-NIC2 


R4-SW1-P15 


R4-S16-SER 


R4-SW2-P16 


R4-S16-NIC1 


R2-SW1-M16-P11 


R4-S16-NIC2 


R4-SW1-P16 


R4-S17-SER 


R4-SW2-P17 


R4-S17-NIC1 


R2-SW1-M16-P12 


R4-S17-NIC2 


R4-SW1-P17 


R4-S18-SER 


R4-SW2-P18 


R4-S18-NIC1 


R2-SW1-M16-P13 


R4-S18-NIC2 


R4-SW1-P18 


R4-S19-SER 


R4-SW2-P1 9 


R4-S19-NIC1 


R2-SW1-M16-P14 


R4-S19-NIC2 


R4-SW1-P19 


R4-S20-SER 


R4-SW2-P20 


R4-S20-NIC1 


R2-SW1-M16-P15 


R4-S20-NIC2 


R4-SW1-P20 



Table 12-3: Myricom Monitor 


From 


To 


R2-SW1-M17-P1 


R2-SW2-P47 
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Table 12-4: OOB Management Switch Uplink 


From 


To 


R1-SW2-P48 


R1-SW1-P48 


R2-SW3-P48 


R2-SW2-P48 


R3-SW2-P48 


R3-SW1-P48 


R4-SW2-P48 


R4-SW1-P48 



Table 12-5: IB Management Switch Uplink 


From 


To 




R2-SW2-P46 


R1-SW1-P47 


Trunked together 


R2-SW2-P45 


R1-SW1-P46 


R2-SW2-P44 


R1-SW1-P45 


R2-SW2-P43 


R1-SW1-P44 


R2-SW2-P42 


R3-SW1-P47 


Trunked together 


R2-SW2-P41 


R3-SW1-P46 


R2-SW2-P40 


R3-SW1-P45 


R2-SW2-P39 


R3-SW1-P44 


R2-SW2-P38 


R4-SW1-P47 


Trunked together 


R2-SW2-P37 


R4-SW1-P46 


R2-SW2-P36 


R4-SW1-P45 


R2-SW2-P35 


R4-SW1-P44 



12-8 



HP High Performance Clusters LC 1000 Series Cabling Guide 



13 



64 Node Fast Ethernet Expandable to 192 Nodes 





DL140 


NIC1 - 


Compute 


N1C2 - 
Serial - 


Node 


ATA 2 - 




ATA 1 - 






DL140 


NIC1 - 


Compute 


NIC2- 

Serial - 
ATA 2 _ 
ATA 1 - 


Node 






DL140 




Compute 


NIC2- 

Serial - 
ATA 2 - 
ATA 1 - 


Node 



I 


DL140 


NIC1 - 


Compute 


N1C2 - 


Node 


ATA 2 - 




ATA 1 - 


• 




• 




• 





Compute nic2- 

Serial - 

Node ATA 2 ' 







DL380 


iLO- 
NIC2- 


Control 


NIC1- 


Node 


Serial - 
SCSI 2 — 
SCSI 1 - 





DL140 


NICl - 


Compute 


NIC2 - 


Node 


ATA 2 - 




ATA 1 - 



EE 






DL140 




Compute 


NIC2 - 
Serial - 
ATA 2 - 
ATA 1 - 


Node 



Public LAN 
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Rack Diagram 



Rack 1 (R1) 



Rack 2 (R2) 



42 


S40 


Expansion 


41 


S39 


Expansion 


40 


S38 


Expansion 


39 


S37 


Expansion 


38 


S36 


Expansion 


37 


S35 


Expansion 


36 


S34 


Expansion 


35 


S33 


Expansion 


34 


S32 


□ L140 


33 


S31 


DL140 


32 


S30 


DL140 


31 


S29 


DL140 


30 


S28 


DL140 


29 


S27 


DL140 


28 


S26 


□ L140 


27 


S25 


DL140 


26 


S24 


DL140 


25 


S23 


□ L140 


24 


S22 


DL140 


23 


S21 


DL140 


22 


SW2 


Cyclades 


21 


SW1 


ProCurve 2650 


20 


S20 


DL140 


19 


S19 


DL140 


18 


S18 


DL140 


17 


S17 


DL140 


16 


S16 


DL140 


15 


S15 


DL140 


14 


S14 


DL140 


13 


S13 


DL140 


12 


S12 


DL140 


11 


S11 


DL140 


10 


S10 


DL140 


9 


S9 


DL140 


8 


S8 


DL140 


7 


S7 


DL140 


6 


S6 


DL140 


5 


S5 


DL140 


4 


S4 


DL140 


3 


S3 


DL140 


2 


S2 


DL140 


1 





S33 


DL140 


S32 


DL140 


S31 


DL140 


S30 


DL140 


S29 


DL140 


S28 


DL140 


S27 


DL140 


S26 


DL140 


S25 


DL140 


S24 


DL140 


S23 


DL140 


S22 


DL140 


S21 DL380 


S20 


DL140 


S19 


DL140 


S18 


DL140 


S17 


DL140 


S16 


DL140 


S15 


DL140 


SW3 


Cvclades 


SW2 


ProCurve 2848 


TFT5600 


S14 


DL140 


S13 


DL140 


S12 


DL140 


S11 


DL140 


S10 


□ L140 


S9 


DL140 


S8 


DL140 


S7 


DL140 


S6 


DL140 


S5 


DL140 


S4 


DL140 


S3 


DL140 


S2 


DL140 


S1 


DL140 


SW1 


ProCurve 5372 



Rack 3 (R3) 



S40 


Expansion 


S39 


Expansion 


S38 


Expansion 


S37 


Expansion 


S36 


Expansion 


S35 


Expansion 


S34 


Expansion 


S33 


Expansion 


S32 


Expansion 


S31 


Expansion 


S30 


Expansion 


S29 


Expansion 


S28 


Expansion 


S27 


Expansion 


S26 


Expansion 


S25 


Expansion 


S24 


Expansion 


S23 


Expansion 


S22 


Expansion 


S21 


Expansion 


SW2 


Expansion 


SW1 


Expansion 


S20 


Expansion 


S19 


Expansion 


S18 


Expansion 


S17 


Expansion 


S16 


Expansion 


S15 


Expansion 


S14 


Expansion 


S13 


Expansion 


S12 


Expansion 


S11 


Expansion 


S10 


Expansion 


S9 


Expansion 


S8 


Expansion 


S7 


Expansion 


S6 


Expansion 


S5 


Expansion 


S4 


Expansion 


S3 


Expansion 


S2 


Expansion 


S1 


Expansion 



Rack 4 (R4) 



S40 


Expansion 


S39 


Expansion 


S38 


Expansion 


S37 


Expansion 


S36 


Expansion 


S35 


Expansion 


S34 


Expansion 


S33 


Expansion 


S32 


Expansion 


S31 


Expansion 


S30 


Expansion 


S29 


Expansion 


S28 


Expansion 


S27 


Expansion 


S26 


Expansion 


S25 


Expansion 


S24 


Expansion 


S23 


Expansion 


S22 


Expansion 


S21 


Expansion 


SW2 


Expansion 


SW1 


Expansion 


S20 


Expansion 


S19 


Expansion 


S18 


Expansion 


S17 


Expansion 


S16 


Expansion 


S15 


Expansion 


S14 


Expansion 


S13 


Expansion 


S12 


Expansion 


S11 


Expansion 


S10 


Expansion 


S9 


Expansion 


S8 


Expansion 


S7 


Expansion 


S6 


Expansion 


S5 


Expansion 


S4 


Expansion 


S3 


Expansion 


S2 


Expansion 


S1 


Expansion 



Rack 5 (R5) 



S40 


Expansion 


S39 


Expansion 


S38 


Expansion 


S37 


Expansion 


S36 


Expansion 


S35 


Expansion 


S34 


Expansion 


S33 


Expansion 


S32 


Expansion 


S31 


Expansion 


S30 


Expansion 


S29 


Expansion 


S28 


Expansion 


S27 


Expansion 


S26 


Expansion 


S25 


Expansion 


S24 


Expansion 


S23 


Expansion 


S22 


Expansion 


S21 


Expansion 


SW2 Expansion 


SW1 


Expansion 


S20 


Expansion 


S19 


Expansion 


S18 


Expansion 


S17 


Expansion 


S16 


Expansion 


S15 


Expansion 


S14 


Expansion 


S13 


Expansion 


S12 


Expansion 


S11 


Expansion 


S10 


Expansion 


S9 


Expansion 


S8 


Expansion 


S7 


Expansion 


S6 


Expansion 


S5 


Expansion 


S4 


Expansion 


S3 


Expansion 


S2 


Expansion 


S1 


Expansion 
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Table 13-1: Cable Label Nomenclature 


Symbol 


Description 


R 


Rack number 


S 


Control/Compute/Storage node number 


SW 


Out of Band (OOB) Management Switch/Cluster Interconnect Switch/In Band (IB) 
Management Switch number 


M 


Module letter or Module number 


P 


Port number 


NIC 


NIC port number 


SER 


Serial port 



Table 13-2: 64 Node Fast Ethernet Cabling for DL140 LC Clusters Expandable to 192 Nodes 


OOB Switch Cabling 


Cluster Interconnect Switch Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R1-S1-SER 


R1-SW2-P1 


R1-S1-NIC1 


R2-SW1-MC-P9 


R1-S1-NIC2 


R1-SW1-P1 


R1-S2-SER 


R1-SW2-P2 


R1-S2-NIC1 


R2-SW1-MC-P10 


R1-S2-NIC2 


R1-SW1-P2 


R1-S3-SER 


R1-SW2-P3 


R1-S3-NIC1 


R2-SW1-MC-P11 


R1-S3-NIC2 


R1-SW1-P3 


R1-S4-SER 


R1-SW2-P4 


R1-S4-NIC1 


R2-SW1-MC-P12 


R1-S4-NIC2 


R1-SW1-P4 


R1-S5-SER 


R1-SW2-P5 


R1-S5-NIC1 


R2-SW1-MC-P13 


R1-S5-NIC2 


R1-SW1-P5 


R1-S6-SER 


R1-SW2-P6 


R1-S6-NIC1 


R2-SW1-MC-P14 


R1-S6-NIC2 


R1-SW1-P6 


R1-S7-SER 


R1-SW2-P7 


R1-S7-NIC1 


R2-SW1-MC-P15 


R1-S7-NIC2 


R1-SW1-P7 


R1-S8-SER 


R1-SW2-P8 


R1-S8-NIC1 


R2-SW1-MC-P16 


R1-S8-NIC2 


R1-SW1-P8 


R1-S9-SER 


R1-SW2-P9 


R1-S9-NIC1 


R2-SW1-MC-P17 


R1-S9-NIC2 


R1-SW1-P9 


R1-S10-SER 


R1-SW2-P10 


R1-S10-NIC1 


R2-SW1-MC-P18 


R1-S10-NIC2 


R1-SW1-P10 


R1-S11-SER 


R1-SW2-P11 


R1-S11-NIC1 


R2-SW1-MC-P19 


R1-S11-NIC2 


R1-SW1-P11 


R1-S12-SER 


R1-SW2-P12 


R1-S12-NIC1 


R2-SW1-MC-P20 


R1-S12-NIC2 


R1-SW1-P12 


R1-S13-SER 


R1-SW2-P13 


R1-S13-NIC1 


R2-SW1-MC-P21 


R1-S13-NIC2 


R1-SW1-P13 
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continued 



00B Switch Cabling 


Cluster Interconnect Switch Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R1-S14-SER 


R1-SW2-P14 


R1-S14-NIC1 


R2-SW1-MC-P22 


R1-S14-NIC2 


R1-SW1-P14 


R1-S15-SER 


R1-SW2-P15 


R1-S15-NIC1 


R2-SW1-MC-P23 


R1-S15-NIC2 


R1-SW1-P15 


R1-S16-SER 


R1-SW2-P16 


R1-S16-NIC1 


R2-SW1-MC-P24 


R1-S16-NIC2 


R1-SW1-P16 


R1-S17-SER 


R1-SW2-P17 


R1-S17-NIC1 


R2-SW1-MD-P1 


R1-S17-NIC2 


R1-SW1-P17 


R1-S18-SER 


R1-SW2-P18 


R1-S18-NIC1 


R2-SW1-MD-P2 


R1-S18-NIC2 


R1-SW1-P18 


R1-S19-SER 


R1-SW2-P19 


R1-S19-NIC1 


R2-SW1-MD-P3 


R1-S19-NIC2 


R1-SW1-P19 


R1-S20-SER 


R1-SW2-P20 


R1-S20-NIC1 


R2-SW1-MD-P4 


R1-S20-NIC2 


R1-SW1-P20 


R1-S21-SER 


R1-SW2-P21 


R1-S21-NIC1 


R2-SW1-MD-P5 


R1-S21-NIC2 


R1-SW1-P21 


R1-S22-SER 


R1-SW2-P22 


R1-S22-NIC1 


R2-SW1-MD-P6 


R1-S22-NIC2 


R1-SW1-P22 


R1-S23-SER 


R1-SW2-P23 


R1-S23-NIC1 


R2-SW1-MD-P7 


R1-S23-NIC2 


R1-SW1-P23 


R1-S24-SER 


R1-SW2-P24 


R1-S24-NIC1 


R2-SW1-MD-P8 


R1-S24-NIC2 


R1-SW1-P24 


R1-S25-SER 


R1-SW2-P25 


R1-S25-NIC1 


R2-SW1-MD-P9 


R1-S25-NIC2 


R1-SW1-P25 


R1-S26-SER 


R1-SW2-P26 


R1-S26-NIC1 


R2-SW1-MD-P10 


R1-S26-NIC2 


R1-SW1-P26 


R1-S27-SER 


R1-SW2-P27 


R1-S27-NIC1 


R2-SW1-MD-P11 


R1-S27-NIC2 


R1-SW1-P27 


R1-S28-SER 


R1-SW2-P28 


R1-S28-NIC1 


R2-SW1-MD-P12 


R1-S28-NIC2 


R1-SW1-P28 


R1-S29-SER 


R1-SW2-P29 


R1-S29-NIC1 


R2-SW1-MD-P13 


R1-S29-NIC2 


R1-SW1-P29 


R1-S30-SER 


R1-SW2-P30 


R1-S30-NIC1 


R2-SW1-MD-P14 


R1-S30-NIC2 


R1-SW1-P30 


R1-S31-SER 


R1-SW2-P31 


R1-S31-NIC1 


R2-SW1-MD-P15 


R1-S31-NIC2 


R1-SW1-P31 


R1-S32-SER 


R1-SW2-P32 


R1-S32-NIC1 


R2-SW1-MD-P16 


R1-S32-NIC2 


R1-SW1-P32 


R1-S33-SER 


R1-SW2-P33 


R1-S33-NIC1 


R2-SW1-MD-P17 


R1-S33-NIC2 


R1-SW1-P33 


R1-S34-SER 


R1-SW2-P34 


R1-S34-NIC1 


R2-SW1-MD-P18 


R1-S34-NIC2 


R1-SW1-P34 


R1-S35-SER 


R1-SW2-P35 


R1-S35-NIC1 


R2-SW1-MD-P19 


R1-S35-NIC2 


R1-SW1-P35 


R1-S36-SER 


R1-SW2-P36 


R1-S36-NIC1 


R2-SW1-MD-P20 


R1-S36-NIC2 


R1-SW1-P36 


R1-S37-SER 


R1-SW2-P37 


R1-S37-NIC1 


R2-SW1-MD-P21 


R1-S37-NIC2 


R1-SW1-P37 


R1-S38-SER 


R1-SW2-P38 


R1-S38-NIC1 


R2-SW1-MD-P22 


R1-S38-NIC2 


R1-SW1-P38 


R1-S39-SER 


R1-SW2-P39 


R1-S39-NIC1 


R2-SW1-MD-P23 


R1-S39-NIC2 


R1-SW1-P39 


R1-S40-SER 


R1-SW2-P40 


R1-S40-NIC1 


R2-SW1-MD-P24 


R1-S40-NIC2 


R1-SW1-P40 


R2-S1-SER 


R2-SW3-P1 


R2-S1-NIC1 


R2-SW1-MB-P1 


R2-S1-NIC2 


R2-SW2-P1 


R2-S2-SER 


R2-SW3-P2 


R2-S2-NIC1 


R2-SW1-MB-P2 


R2-S2-NIC2 


R2-SW2-P2 


R2-S3-SER 


R2-SW3-P3 


R2-S3-NIC1 


R2-SW1-MB-P3 


R2-S3-NIC2 


R2-SW2-P3 



continued 



13-4 



HP High Performance Clusters LC 1000 Series Cabling Guide 



64 Node Fast Ethernet Expandable to 192 Nodes 



Table 13-2: 64 Node Fast Ethernet Cabling for DL140 LC Clusters Expandable to 192 Nodes 

continued 



00B Switch Cabling 


Cluster Interconnect Switch Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R2-S4-SER 


R2-SW3-P4 


R2-S4-NIC1 


R2-SW1-MB-P4 


R2-S4-NIC2 


R2-SW2-P4 


R2-S5-SER 


R2-SW3-P5 


R2-S5-NIC1 


R2-SW1-MB-P5 


R2-S5-NIC2 


R2-SW2-P5 


R2-S6-SER 


R2-SW3-P6 


R2-S6-NIC1 


R2-SW1-MB-P6 


R2-S6-NIC2 


R2-SW2-P6 


R2-S7-SER 


R2-SW3-P7 


R2-S7-NIC1 


R2-SW1-MB-P7 


R2-S7-NIC2 


R2-SW2-P7 


R2-S8-SER 


R2-SW3-P8 


R2-S8-NIC1 


R2-SW1-MB-P8 


R2-S8-NIC2 


R2-SW2-P8 


R2-S9-SER 


R2-SW3-P9 


R2-S9-NIC1 


R2-SW1-MB-P9 


R2-S9-NIC2 


R2-SW2-P9 


R2-S10-SER 


R2-SW3-P10 


R2-S10-NIC1 


R2-SW1-MB-P10 


R2-S10-NIC2 


R2-SW2-P10 


R2-S11-SER 


R2-SW3-P11 


R2-S11-NIC1 


R2-SW1-MB-P11 


R2-S11-NIC2 


R2-SW2-P1 1 


R2-S12-SER 


R2-SW3-P12 


R2-S12-NIC1 


R2-SW1-MB-P12 


R2-S12-NIC2 


R2-SW2-P12 


R2-S13-SER 


R2-SW3-P13 


R2-S13-NIC1 


R2-SW1-MB-P13 


R2-S13-NIC2 


R2-SW2-P13 


R2-S14-SER 


R2-SW3-P14 


R2-S14-NIC1 


R2-SW1-MB-P14 


R2-S14-NIC2 


R2-SW2-P14 


R2-S15-SER 


R2-SW3-P15 


R2-S15-NIC1 


R2-SW1-MB-P15 


R2-S15-NIC2 


R2-SW2-P15 


R2-S16-SER 


R2-SW3-P16 


R2-S16-NIC1 


R2-SW1-MB-P16 


R2-S16-NIC2 


R2-SW2-P16 


R2-S17-SER 


R2-SW3-P17 


R2-S17-NIC1 


R2-SW1-MB-P17 


R2-S17-NIC2 


R2-SW2-P17 


R2-S18-SER 


R2-SW3-P18 


R2-S18-NIC1 


R2-SW1-MB-P18 


R2-S18-NIC2 


R2-SW2-P18 


R2-S19-SER 


R2-SW3-P19 


R2-S19-NIC1 


R2-SW1-MB-P19 


R2-S19-NIC2 


R2-SW2-P19 


R2-S20-SER 


R2-SW3-P20 


R2-S20-NIC1 


R2-SW1-MB-P20 


R2-S20-NIC2 


R2-SW2-P20 


R2-S21-SER 


R2-SW3-P21 


N/A 


N/A 


R2-S21-NIC2 


R2-SW2-P21 


R2-S22-SER 


R2-SW3-P22 


R2-S22-NIC1 


R2-SW1-MB-P21 


R2-S22-NIC2 


R2-SW2-P22 


R2-S23-SER 


R2-SW3-P23 


R2-S23-NIC1 


R2-SW1-MB-P22 


R2-S23-NIC2 


R2-SW2-P23 


R2-S24-SER 


R2-SW3-P24 


R2-S24-NIC1 


R2-SW1-MB-P23 


R2-S24-NIC2 


R2-SW2-P24 


R2-S25-SER 


R2-SW3-P25 


R2-S25-NIC1 


R2-SW1-MB-P24 


R2-S25-NIC2 


R2-SW2-P25 


R2-S26-SER 


R2-SW3-P26 


R2-S26-NIC1 


R2-SW1-MC-P1 


R2-S26-NIC2 


R2-SW2-P26 


R2-S27-SER 


R2-SW3-P27 


R2-S27-NIC1 


R2-SW1-MC-P2 


R2-S27-NIC2 


R2-SW2-P27 


R2-S28-SER 


R2-SW3-P28 


R2-S28-NIC1 


R2-SW1-MC-P3 


R2-S28-NIC2 


R2-SW2-P28 


R2-S29-SER 


R2-SW3-P29 


R2-S29-NIC1 


R2-SW1-MC-P4 


R2-S29-NIC2 


R2-SW2-P29 


R2-S30-SER 


R2-SW3-P30 


R2-S30-NIC1 


R2-SW1-MC-P5 


R2-S30-NIC2 


R2-SW2-P30 


R2-S31-SER 


R2-SW3-P31 


R2-S31-NIC1 


R2-SW1-MC-P6 


R2-S31-NIC2 


R2-SW2-P31 


R2-S32-SER 


R2-SW3-P32 


R2-S32-NIC1 


R2-SW1-MC-P7 


R2-S32-NIC2 


R2-SW2-P32 


R2-S33-SER 


R2-SW3-P33 


R2-S33-NIC1 


R2-SW1-MC-P8 


R2-S33-NIC2 


R2-SW2-P33 
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continued 



00B Switch Cabling 


Cluster Interconnect Switch Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R3-S1-SER 


R3-SW2-P1 


R3-S1-NIC1 


R2-SW1-ME-P1 


R3-S1-NIC2 


R3-SW1-P1 


R3-S2-SER 


R3-SW2-P2 


R3-S2-NIC1 


R2-SW1-ME-P2 


R3-S2-NIC2 


R3-SW1-P2 


R3-S3-SER 


R3-SW2-P3 


R3-S3-NIC1 


R2-SW1-ME-P3 


R3-S3-NIC2 


R3-SW1-P3 


R3-S4-SER 


R3-SW2-P4 


R3-S4-NIC1 


R2-SW1-ME-P4 


R3-S4-NIC2 


R3-SW1-P4 


R3-S5-SER 


R3-SW2-P5 


R3-S5-NIC1 


R2-SW1-ME-P5 


R3-S5-NIC2 


R3-SW1-P5 


R3-S6-SER 


R3-SW2-P6 


R3-S6-NIC1 


R2-SW1-ME-P6 


R3-S6-NIC2 


R3-SW1-P6 


R3-S7-SER 


R3-SW2-P7 


R3-S7-NIC1 


R2-SW1-ME-P7 


R3-S7-NIC2 


R3-SW1-P7 


R3-S8-SER 


R3-SW2-P8 


R3-S8-NIC1 


R2-SW1-ME-P8 


R3-S8-NIC2 


R3-SW1-P8 


R3-S9-SER 


R3-SW2-P9 


R3-S9-NIC1 


R2-SW1-ME-P9 


R3-S9-NIC2 


R3-SW1-P9 


R3-S10-SER 


R3-SW2-P10 


R3-S10-NIC1 


R2-SW1-ME-P10 


R3-S10-NIC2 


R3-SW1-P10 


R3-S11-SER 


R3-SW2-P1 1 


R3-S11-NIC1 


R2-SW1-ME-P11 


R3-S11-NIC2 


R3-SW1-P11 


R3-S12-SER 


R3-SW2-P12 


R3-S12-NIC1 


R2-SW1-ME-P12 


R3-S12-NIC2 


R3-SW1-P12 


R3-S13-SER 


R3-SW2-P13 


R3-S13-NIC1 


R2-SW1-ME-P13 


R3-S13-NIC2 


R3-SW1-P13 


R3-S14-SER 


R3-SW2-P14 


R3-S14-NIC1 


R2-SW1-ME-P14 


R3-S14-NIC2 


R3-SW1-P14 


R3-S15-SER 


R3-SW2-P15 


R3-S15-NIC1 


R2-SW1-ME-P15 


R3-S15-NIC2 


R3-SW1-P15 


R3-S16-SER 


R3-SW2-P16 


R3-S16-NIC1 


R2-SW1-ME-P16 


R3-S16-NIC2 


R3-SW1-P16 


R3-S17-SER 


R3-SW2-P17 


R3-S17-NIC1 


R2-SW1-ME-P17 


R3-S17-NIC2 


R3-SW1-P17 


R3-S18-SER 


R3-SW2-P18 


R3-S18-NIC1 


R2-SW1-ME-P18 


R3-S18-NIC2 


R3-SW1-P18 


R3-S19-SER 


R3-SW2-P19 


R3-S19-NIC1 


R2-SW1-ME-P19 


R3-S19-NIC2 


R3-SW1-P19 


R3-S20-SER 


R3-SW2-P20 


R3-S20-NIC1 


R2-SW1-ME-P20 


R3-S20-NIC2 


R3-SW1-P20 


R3-S21-SER 


R3-SW2-P21 


R3-S21-NIC1 


R2-SW1-ME-P21 


R3-S21-NIC2 


R3-SW1-P21 


R3-S22-SER 


R3-SW2-P22 


R3-S22-NIC1 


R2-SW1-ME-P22 


R3-S22-NIC2 


R3-SW1-P22 


R3-S23-SER 


R3-SW2-P23 


R3-S23-NIC1 


R2-SW1-ME-P23 


R3-S23-NIC2 


R3-SW1-P23 


R3-S24-SER 


R3-SW2-P24 


R3-S24-NIC1 


R2-SW1-ME-P24 


R3-S24-NIC2 


R3-SW1-P24 


R3-S25-SER 


R3-SW2-P25 


R3-S25-NIC1 


R2-SW1-MF-P1 


R3-S25-NIC2 


R3-SW1-P25 


R3-S26-SER 


R3-SW2-P26 


R3-S26-NIC1 


R2-SW1-MF-P2 


R3-S26-NIC2 


R3-SW1-P26 


R3-S27-SER 


R3-SW2-P27 


R3-S27-NIC1 


R2-SW1-MF-P3 


R3-S27-NIC2 


R3-SW1-P27 


R3-S28-SER 


R3-SW2-P28 


R3-S28-NIC1 


R2-SW1-MF-P4 


R3-S28-NIC2 


R3-SW1-P28 


R3-S29-SER 


R3-SW2-P29 


R3-S29-NIC1 


R2-SW1-MF-P5 


R3-S29-NIC2 


R3-SW1-P29 


R3-S30-SER 


R3-SW2-P30 


R3-S30-NIC1 


R2-SW1-MF-P6 


R3-S30-NIC2 


R3-SW1-P30 
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continued 



00B Switch Cabling 


Cluster Interconnect Switch Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R3-S31-SER 


R3-SW2-P31 


R3-S31-NIC1 


R2-SW1-MF-P7 


R3-S31-NIC2 


R3-SW1-P31 


R3-S32-SER 


R3-SW2-P32 


R3-S32-NIC1 


R2-SW1-MF-P8 


R3-S32-NIC2 


R3-SW1-P32 


R3-S33-SER 


R3-SW2-P33 


R3-S33-NIC1 


R2-SW1-MF-P9 


R3-S33-NIC2 


R3-SW1-P33 


R3-S34-SER 


R3-SW2-P34 


R3-S34-NIC1 


R2-SW1-MF-P10 


R3-S34-NIC2 


R3-SW1-P34 


R3-S35-SER 


R3-SW2-P35 


R3-S35-NIC1 


R2-SW1-MF-P11 


R3-S35-NIC2 


R3-SW1-P35 


R3-S36-SER 


R3-SW2-P36 


R3-S36-NIC1 


R2-SW1-MF-P12 


R3-S36-NIC2 


R3-SW1-P36 


R3-S37-SER 


R3-SW2-P37 


R3-S37-NIC1 


R2-SW1-MF-P13 


R3-S37-NIC2 


R3-SW1-P37 


R3-S38-SER 


R3-SW2-P38 


R3-S38-NIC1 


R2-SW1-MF-P14 


R3-S38-NIC2 


R3-SW1-P38 


R3-S39-SER 


R3-SW2-P39 


R3-S39-NIC1 


R2-SW1-MF-P15 


R3-S39-NIC2 


R3-SW1-P39 


R3-S40-SER 


R3-SW2-P40 


R3-S40-NIC1 


R2-SW1-MF-P16 


R3-S40-NIC2 


R3-SW1-P40 


R4-S1-SER 


R4-SW2-P1 


R4-S1-NIC1 


R2-SW1-MF-P17 


R4-S1-NIC2 


R4-SW1-P1 


R4-S2-SER 


R4-SW2-P2 


R4-S2-NIC1 


R2-SW1-MF-P18 


R4-S2-NIC2 


R4-SW1-P2 


R4-S3-SER 


R4-SW2-P3 


R4-S3-NIC1 


R2-SW1-MF-P19 


R4-S3-NIC2 


R4-SW1-P3 


R4-S4-SER 


R4-SW2-P4 


R4-S4-NIC1 


R2-SW1-MF-P20 


R4-S4-NIC2 


R4-SW1-P4 


R4-S5-SER 


R4-SW2-P5 


R4-S5-NIC1 


R2-SW1-MF-P21 


R4-S5-NIC2 


R4-SW1-P5 


R4-S6-SER 


R4-SW2-P6 


R4-S6-NIC1 


R2-SW1-MF-P22 


R4-S6-NIC2 


R4-SW1-P6 


R4-S7-SER 


R4-SW2-P7 


R4-S7-NIC1 


R2-SW1-MF-P23 


R4-S7-NIC2 


R4-SW1-P7 


R4-S8-SER 


R4-SW2-P8 


R4-S8-NIC1 


R2-SW1-MF-P24 


R4-S8-NIC2 


R4-SW1-P8 


R4-S9-SER 


R4-SW2-P9 


R4-S9-NIC1 


R2-SW1-MG-P1 


R4-S9-NIC2 


R4-SW1-P9 


R4-S10-SER 


R4-SW2-P10 


R4-S10-NIC1 


R2-SW1-MG-P2 


R4-S10-NIC2 


R4-SW1-P10 


R4-S11-SER 


R4-SW2-P1 1 


R4-S11-NIC1 


R2-SW1-MG-P3 


R4-S11-NIC2 


R4-SW1-P11 


R4-S12-SER 


R4-SW2-P12 


R4-S12-NIC1 


R2-SW1-MG-P4 


R4-S12-NIC2 


R4-SW1-P12 


R4-S13-SER 


R4-SW2-P13 


R4-S13-NIC1 


R2-SW1-MG-P5 


R4-S13-NIC2 


R4-SW1-P13 


R4-S14-SER 


R4-SW2-P14 


R4-S14-NIC1 


R2-SW1-MG-P6 


R4-S14-NIC2 


R4-SW1-P14 


R4-S15-SER 


R4-SW2-P15 


R4-S15-NIC1 


R2-SW1-MG-P7 


R4-S15-NIC2 


R4-SW1-P15 


R4-S16-SER 


R4-SW2-P16 


R4-S16-NIC1 


R2-SW1-MG-P8 


R4-S16-NIC2 


R4-SW1-P16 


R4-S17-SER 


R4-SW2-P17 


R4-S17-NIC1 


R2-SW1-MG-P9 


R4-S17-NIC2 


R4-SW1-P17 


R4-S18-SER 


R4-SW2-P18 


R4-S18-NIC1 


R2-SW1-MG-P10 


R4-S18-NIC2 


R4-SW1-P18 


R4-S19-SER 


R4-SW2-P19 


R4-S19-NIC1 


R2-SW1-MG-P11 


R4-S19-NIC2 


R4-SW1-P19 


R4-S20-SER 


R4-SW2-P20 


R4-S20-NIC1 


R2-SW1-MG-P12 


R4-S20-NIC2 


R4-SW1-P20 
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Table 13-2: 64 Node Fast Ethernet Cabling for DL140 LC Clusters Expandable to 192 Nodes 

continued 



00B Switch Cabling 


Cluster Interconnect Switch Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R4-S21-SER 


R4-SW2-P21 


R4-S21-NIC1 


R2-SW1-MG-P13 


R4-S21-NIC2 


R4-SW1-P21 


R4-S22-SER 


R4-SW2-P22 


R4-S22-NIC1 


R2-SW1-MG-P14 


R4-S22-NIC2 


R4-SW1-P22 


R4-S23-SER 


R4-SW2-P23 


R4-S23-NIC1 


R2-SW1-MG-P15 


R4-S23-NIC2 


R4-SW1-P23 


R4-S24-SER 


R4-SW2-P24 


R4-S24-NIC1 


R2-SW1-MG-P16 


R4-S24-NIC2 


R4-SW1-P24 


R4-S25-SER 


R4-SW2-P25 


R4-S25-NIC1 


R2-SW1-MG-P17 


R4-S25-NIC2 


R4-SW1-P25 


R4-S26-SER 


R4-SW2-P26 


R4-S26-NIC1 


R2-SW1-MG-P18 


R4-S26-NIC2 


R4-SW1-P26 


R4-S27-SER 


R4-SW2-P27 


R4-S27-NIC1 


R2-SW1-MG-P19 


R4-S27-NIC2 


R4-SW1-P27 


R4-S28-SER 


R4-SW2-P28 


R4-S28-NIC1 


R2-SW1-MG-P20 


R4-S28-NIC2 


R4-SW1-P28 


R4-S29-SER 


R4-SW2-P29 


R4-S29-NIC1 


R2-SW1-MG-P21 


R4-S29-NIC2 


R4-SW1-P29 


R4-S30-SER 


R4-SW2-P30 


R4-S30-NIC1 


R2-SW1-MG-P22 


R4-S30-NIC2 


R4-SW1-P30 


R4-S31-SER 


R4-SW2-P31 


R4-S31-NIC1 


R2-SW1-MG-P23 


R4-S31-NIC2 


R4-SW1-P31 


R4-S32-SER 


R4-SW2-P32 


R4-S32-NIC1 


R2-SW1-MG-P24 


R4-S32-NIC2 


R4-SW1-P32 


R4-S33-SER 


R4-SW2-P33 


R4-S33-NIC1 


R2-SW1-MH-P1 


R4-S33-NIC2 


R4-SW1-P33 


R4-S34-SER 


R4-SW2-P34 


R4-S34-NIC1 


R2-SW1-MH-P2 


R4-S34-NIC2 


R4-SW1-P34 


R4-S35-SER 


R4-SW2-P35 


R4-S35-NIC1 


R2-SW1-MH-P3 


R4-S35-NIC2 


R4-SW1-P35 


R4-S36-SER 


R4-SW2-P36 


R4-S36-NIC1 


R2-SW1-MH-P4 


R4-S36-NIC2 


R4-SW1-P36 


R4-S37-SER 


R4-SW2-P37 


R4-S37-NIC1 


R2-SW1-MH-P5 


R4-S37-NIC2 


R4-SW1-P37 


R4-S38-SER 


R4-SW2-P38 


R4-S38-NIC1 


R2-SW1-MH-P6 


R4-S38-NIC2 


R4-SW1-P38 


R4-S39-SER 


R4-SW2-P39 


R4-S39-NIC1 


R2-SW1-MH-P7 


R4-S39-NIC2 


R4-SW1-P39 


R4-S40-SER 


R4-SW2-P40 


R4-S40-NIC1 


R2-SW1-MH-P8 


R4-S40-NIC2 


R4-SW1-P40 


R5-S1-SER 


R5-SW2-P1 


R5-S1-NIC1 


R2-SW1-MH-P9 


R5-S1-NIC2 


R5-SW1-P1 


R5-S2-SER 


R5-SW2-P2 


R5-S2-NIC1 


R2-SW1-MH-P10 


R5-S2-NIC2 


R5-SW1-P2 


R5-S3-SER 


R5-SW2-P3 


R5-S3-NIC1 


R2-SW1-MH-P11 


R5-S3-NIC2 


R5-SW1-P3 


R5-S4-SER 


R5-SW2-P4 


R5-S4-NIC1 


R2-SW1-MH-P12 


R5-S4-NIC2 


R5-SW1-P4 


R5-S5-SER 


R5-SW2-P5 


R5-S5-NIC1 


R2-SW1-MH-P13 


R5-S5-NIC2 


R5-SW1-P5 


R5-S6-SER 


R5-SW2-P6 


R5-S6-NIC1 


R2-SW1-MH-P14 


R5-S6-NIC2 


R5-SW1-P6 


R5-S7-SER 


R5-SW2-P7 


R5-S7-NIC1 


R2-SW1-MH-P15 


R5-S7-NIC2 


R5-SW1-P7 


R5-S8-SER 


R5-SW2-P8 


R5-S8-NIC1 


R2-SW1-MH-P16 


R5-S8-NIC2 


R5-SW1-P8 


R5-S9-SER 


R5-SW2-P9 


R5-S9-NIC1 


R2-SW1-MH-P17 


R5-S9-NIC2 


R5-SW1-P9 


R5-S10-SER 


R5-SW2-P10 


R5-S10-NIC1 


R2-SW1-MH-P18 


R5-S10-NIC2 


R5-SW1-P10 
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Table 13-2: 64 Node Fast Ethernet Cabling for DL140 LC Clusters Expandable to 192 Nodes 

continued 



00B Switch Cabling 


Cluster Interconnect Switch Cabling 


IB Management Switch Cabling 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


Origin (server) 


Destination 
(switch) 


R5-S11-SER 


R5-SW2-P1 1 


R5-S11-NIC1 


R2-SW1-MH-P19 


R5-S11-NIC2 


R5-SW1-P11 


R5-S12-SER 


R5-SW2-P12 


R5-S12-NIC1 


R2-SW1-MH-P20 


R5-S12-NIC2 


R5-SW1-P12 


R5-S13-SER 


R5-SW2-P13 


R5-S13-NIC1 


R2-SW1-MH-P21 


R5-S13-NIC2 


R5-SW1-P13 


R5-S14-SER 


R5-SW2-P14 


R5-S14-NIC1 


R2-SW1-MH-P22 


R5-S14-NIC2 


R5-SW1-P14 


R5-S15-SER 


R5-SW2-P15 


R5-S15-NIC1 


R2-SW1-MH-P23 


R5-S15-NIC2 


R5-SW1-P15 


R5-S16-SER 


R5-SW2-P16 


R5-S16-NIC1 


R2-SW1-MH-P24 


R5-S16-NIC2 


R5-SW1-P16 


R5-S17-SER 


R5-SW2-P17 


R5-S17-NIC1 


R2-SW1-MA-P1 


R5-S17-NIC2 


R5-SW1-P17 


R5-S18-SER 


R5-SW2-P18 


R5-S18-NIC1 


R2-SW1-MA-P2 


R5-S18-NIC2 


R5-SW1-P18 


R5-S19-SER 


R5-SW2-P19 


R5-S19-NIC1 


R2-SW1-MA-P3 


R5-S19-NIC2 


R5-SW1-P19 


R5-S20-SER 


R5-SW2-P20 


R5-S20-NIC1 


R2-SW1-MA-P4 


R5-S20-NIC2 


R5-SW1-P20 


R5-S21-SER 


R5-SW2-P21 


R5-S21-NIC1 


R2-SW1-MA-P5 


R5-S21-NIC2 


R5-SW1-P21 


R5-S22-SER 


R5-SW2-P22 


R5-S22-NIC1 


R2-SW1-MA-P6 


R5-S22-NIC2 


R5-SW1-P22 


R5-S23-SER 


R5-SW2-P23 


R5-S23-NIC1 


R2-SW1-MA-P7 


R5-S23-NIC2 


R5-SW1-P23 


R5-S24-SER 


R5-SW2-P24 


R5-S24-NIC1 


R2-SW1-MA-P8 


R5-S24-NIC2 


R5-SW1-P24 


R5-S25-SER 


R5-SW2-P25 


R5-S25-NIC1 


R2-SW1-MA-P9 


R5-S25-NIC2 


R5-SW1-P25 


R5-S26-SER 


R5-SW2-P26 


R5-S26-NIC1 


R2-SW1-MA-P10 


R5-S26-NIC2 


R5-SW1-P26 


R5-S27-SER 


R5-SW2-P27 


R5-S27-NIC1 


R2-SW1-MA-P11 


R5-S27-NIC2 


R5-SW1-P27 


R5-S28-SER 


R5-SW2-P28 


R5-S28-NIC1 


R2-SW1-MA-P12 


R5-S28-NIC2 


R5-SW1-P28 


R5-S29-SER 


R5-SW2-P29 


R5-S29-NIC1 


R2-SW1-MA-P13 


R5-S29-NIC2 


R5-SW1-P29 


R5-S30-SER 


R5-SW2-P30 


R5-S30-NIC1 


R2-SW1-MA-P14 


R5-S30-NIC2 


R5-SW1-P30 


R5-S31-SER 


R5-SW2-P31 


R5-S31-NIC1 


R2-SW1-MA-P15 


R5-S31-NIC2 


R5-SW1-P31 


R5-S32-SER 


R5-SW2-P32 


R5-S32-NIC1 


R2-SW1-MA-P16 


R5-S32-NIC2 


R5-SW1-P32 


R5-S33-SER 


R5-SW2-P33 


R5-S33-NIC1 


R2-SW1-MA-P17 


R5-S33-NIC2 


R5-SW1-P33 


R5-S34-SER 


R5-SW2-P34 


R5-S34-NIC1 


R2-SW1-MA-P18 


R5-S34-NIC2 


R5-SW1-P34 


R5-S35-SER 


R5-SW2-P35 


R5-S35-NIC1 


R2-SW1-MA-P19 


R5-S35-NIC2 


R5-SW1-P35 


R5-S36-SER 


R5-SW2-P36 


R5-S36-NIC1 


R2-SW1-MA-P20 


R5-S36-NIC2 


R5-SW1-P36 


R5-S37-SER 


R5-SW2-P37 


R5-S37-NIC1 


R2-SW1-MA-P21 


R5-S37-NIC2 


R5-SW1-P37 


R5-S38-SER 


R5-SW2-P38 


R5-S38-NIC1 


R2-SW1-MA-P22 


R5-S38-NIC2 


R5-SW1-P38 


R5-S39-SER 


R5-SW2-P39 


R5-S39-NIC1 


R2-SW1-MA-P23 


R5-S39-NIC2 


R5-SW1-P39 


R5-S40-SER 


R5-SW2-P40 


R5-S40-NIC1 


R2-SW1-MA-P24 


R5-S40-NIC2 


R5-SW1-P40 
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Table 13-3: OOB Management Switch Uplink 


From 


To 


R1-SW2-P48 


R1-SW1-P48 


R2-SW3-P48 


R2-SW2-P48 


R3-SW2-P48 


R3-SW1-P48 


R4-SW2-P48 


R4-SW1-P48 


R5-SW2-P48 


R5-SW1-P48 



Table 13-4: IB Management Switch Uplink 


From 


To 




R2-SW2-P47 


R1-SW1-P50 


Trunked together 


R2-SW2-P46 


R1-SW1-P49 


R2-SW2-P45 


R3-SW1-P50 


Trunked together 


R2-SW2-P44 


R3-SW1-P49 


R2-SW2-P43 


R4-SW1-P50 


Trunked together 


R2-SW2-P42 


R4-SW1-P49 


R2-SW2-P41 


R5-SW1-P50 


Trunked together 


R2-SW2-P40 


R5-SW1-P49 
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Cabling Rules for LC Clusters 



HP factory-configured LC clusters are built according to these guidelines for numbering, 
labeling, and populating LC clusters. The guidelines are included in this document as 
reference information for customers who are customizing or upgrading existing LC clusters. 

Numbering and Cable Labeling Rules 

Racks — Racks are numbered 1 to n and from left to right. The racks are labeled "Rack n," 
where n is the rack number. Cable labels include the rack number and are labeled "Rn," 
where n is the rack number. 

Servers — Servers are numbered from 1 to n and from bottom to top in each rack. Labels on 
cables connected to the servers include "Sn," where n is the server number in the rack. 

Switches — Switches are numbered from 1 to n and from bottom to top in each rack. Labels 
on cables connected to the switches include "SWn," where n is the switch number in the rack. 

Switch Modules (modules, line cards) — Labels on cables connected to the modules use the 
hardware markings with an "M" designator. If the hardware marks a module "A" or "1," then 
the cable labels refer to the modules as "MA" or "Ml," respectively. For modules without 
markings on the hardware, the labels on the cables connected to the modules include "Mn," 
where n is the module number. The module numbering starts at 1 and increases from left to 
right and then bottom to top. 

Ports — Labels on cables connected to the ports use the hardware markings, if available, or 
use "Pn," where n is the port number, if the ports are numbered. For example, if the hardware 
marks ports with "iLO," "NIC1," or "1," then cable labels refer to these ports as "iLO," 
"NIC1," and "PI," respectively. 

Labels on cables connected to ports with no markings on the hardware include "Pn," where n 
is the port number. The numbering starts at 1 and increases from left to right and then bottom 
to top. This port numbering applies to servers, PCI cards with multiple ports, and switches. 

Some hardware, such as a server, can have different types of unlabeled ports. A server may 
have multiple serial ports, NIC ports, and multiple USB ports, for example. Labels on cables 
connected to these ports refer to them by their function and number instead of generically 
labeling all ports from 1 to n. For example, "SER," "NIC1," "NIC2," "USB1," and "USB2." 

If there is only one port on a device, such as a PCI card, n is not used. It is labeled with the 
device name, such as "PCI." 
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PCI Cards — Labels on cables connected to the PCI cards use the PCI slot markings on the 
server if available. The designator of the actual slot name is used on the labels, if present, or 
"PCIn" is used, where n is the slot number, if the slots are numbered. For example, if the 
hardware marks the slots with "1" or "2," then the cable labels refer to these slots as "PCH" 
and "PCI2," respectively. 

If the slots are not uniquely identified by markings on the server, then the numbering starts at 
1 and increases from left to right and then bottom to top. For slots without markings on the 
server, the labels on the cables connected to these PCI cards include "PCIn," where n is the 
slot number. All cable labels to or from PCI cards, regardless of type (NIC, IB, Myrinet), are 
labeled with "PCI." 

If there is only one PCI device used in a server, n is not used. It is labeled "PCI." 

Storage Systems — Storage systems are numbered from 1 to n and from bottom to top in each 
rack. Labels on cables connected to storage devices will include "STn," where n is the storage 
device number in the rack. 

Power — Power cord labeling is according to factory standards. The factory typically uses 
color-coding to label the power cables. 

Rack Population Rules 

Servers, Switches, and Storage System — These components are populated in the rack from 
bottom to top with the lowest numbered component in the lowest rack position. 

Switch Modules and PCI Cards — These components are populated in the lowest available 
module port or slot number. Additional modules and cards are installed in the next higher 
module port or slot number. Exceptions to this rule apply when a specific type of module or 
card must be installed in a specific module port or slot. 

Ports — Ports start with the lowest numbered port and increase unless the following rules 
apply: 

• Switch ports (single function switch, for example: Cyclades terminal server): 

— Server-to-switch connections start with the lowest port and increase. 

— Switch-to-switch connections start with the uplink ports first and then with the 
highest numbered port and work backwards. 

• Switch ports (multi-function switch, for example: 16 node system where the interconnect 
and the management networks connect to the same switch): 

— Server-to-switch connections: The switch is split into "regions" for each functional 
area and then populated from the lowest port number per region and work up. 

— Switch-to-switch connections start with the uplink ports first and then with the 
highest numbered port and work backwards. 

— When dividing the switch into functional regions, be sure to reserve enough ports at 
the top end to handle the switch-to-switch connections. Use this formula to determine 
the number of ports for each region in the switch: ((Total switch ports) - (ports 
reserved for switch-to-switch connections))/(# of regions). 
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Power Connections — The factory distributes the power connections across the PDUs in the 
LC cluster to avoid overload conditions. The most common PDUs used in the LC clusters are 
the 24A and 32A Control Units with four, eight-receptacle Extension Bars. Using these 
PDUs, the factory will not connect more than five components to an Extension Bar and no 
more than 14 total components to each PDU. Different population rules may apply to 
different capacity PDUs. 

Even though the base PDUs can support four, eight-receptacle Extension Bars, the LC 
clusters might not ship with all the Extension Bars if they are not used. Overload conditions 
could result from using unused Extension Bars. 
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